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as  significant  in  the  equation  indicate  positive  and  negative  contributions  to 
squadron  performance  effectiveness.  The  modeling  effort  is  based  on  studies 
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immediate  supervisor  ratings  of  maintenance  technician  performance  in  speed  and 
quality  of  work,  averaged  across  a  squadron.  Based  on  the  analyses  and  results 
of  studies  covering  two  maintenance  squadrons  at  Williams  AFB  and  three  main¬ 
tenance  squadrons  at  Luke  AFB,  the  model  provides  excellent  predictions  of 
squadron  performance  effectiveness  and  highlights  significant  contributing 
factors . 

It  is  recommended  that  the  study  be  extended  to  other  Air  Force  bases  and 
squadrons,  with  the  end  goal  of  achieving  one  or  more  survey-supported  models 
which  could  periodically  be  used  to  evaluate  squadron  performance  and  target 
areas  for  improvement.  The  model  may  also  be  useful  in  evaluating  individual 
technician  performance  within  a  squadron  and  in  developing  life-cycle  costing 
for  maintenance  activity  on  particular  end-item  equipments  maintained  by 
particular  Air  Force  Wings  and  squadrons. 
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GLOSSARY  OF  TERMS 


ASCENDANCY  TRAIT  -  Assertive  in  relationship  with  others;  desire  to  assume  an 
active  role. 

AFSC  -  Air  Force  Specialty  Code 

ASSIGNMENT  LOCALITY  -  Location,  climate,  community  atmosphere. 

EMOTIONAL  STABILITY  TRAIT  -  Well  balanced  and  relatively  free  from  anxieties  and 

nervous  tensions. 

FATIGUE  TRAIT  -  Subjectiveness  to  feelings  of  weariness. 

GROUP  HOMOGENEITY  OF  ATTITUDE  -  Coimion  purpose  and  goals. 

JOB  CURIOSITY  TRAIT  -  Interest  in  discovering  and  learning  all  facets  of  a  job. 

MSET  -  Maintenance  Standardization  and  Evaluation  Team;  MSET  tasks  are  those 
subject  to  Conmand  Team  evaluation. 

ORGANIZATION  CLIMATE/ IDENTITY  -  Atmosphere  which  creates  a  feeling  of  belonging 

as  a  valuable  member  of  a  working  team. 

ORGANIZATIONAL  CLIMATE/REWARD  -  Atmosphere  which  creates  a  feeling  of  being 

rewarded  for  jobs  well  done. 

ORGANIZATIONAL  CLIMATE/RISK  -  Atmosphere  which  creates  a  feeling  of  riskiness 

or  uncertainty  about  job  and/or  organization, 
including  job  safety  hazards. 

ORGANIZATIONAL  CLIMATE/STANDARDS  -  Atmosphere  which  creates  a  feeling  for  the 

perceived  importance  of  implicit  and  explicit 
goals  and  performance  standards. 

ORGANIZATIONAL  CL I MATE/ STRUCTURE  -  Atmosphere  which  creates  a  feeling  of  group 

constraints  via  rules,  regulations,  red 
tape. 

ORGANIZATIONAL  CLIMATE/WARMTH  -  Atmosphere  which  creates  a  feeling  of  general 

good  fellowship. 

ORGANIZATIONAL  IDENTIFICATION  -  Feelings  of  association  with  and  support  from 

the  organization. 

PAY  AND  BENEFITS  SATISFACTION  -  Feelings  of  technician  about  these  extrinsic 

rewards . 

PERSISTENCE  TRAIT  -  Sees  work  through  to  completion. 

PROFESSIONAL  IDENTIFICATION  -  Good  feelings  about  job  speciality  as  important 

and  necessitating  special  skills. 

RANK  -  Position  level  in  AF  organizational  structure. 
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RESPONSIBILITY  TRAIT  -  Positive  and  perservering  in  using  own  judgements; 

determined;  reliable. 

SAINT  -  Systems  Analysis  of  Integrated  Networks  of  Tasks;  a  computerized 
simulation  methodology. 

SOCIAL  STATUS  -  Feelings  about  the  importance  of  occupation  within  society;  a 
perceived  level  of  society  acceptance  and  status. 

SRAM  -  Short  Range  Attack  Missile 


* 

i 

l 

I 

I 


I 


ix 


STATEMENT  OF  WORK 


An  important  current  objective  of  the  United  States  Air  Force  is  to  improve 
the  effectiveness  of  weapon  system  maintenance  and  maintainability.  To  meet 
this  objective,  the  USAF  is  expending  considerable  resources  in  determining  the 
content  of  maintenance  tasks,  in  determining  the  impact  of  equipment  design 
decisions  upon  these  tasks,  in  streamlining  technician  selection  and  training 
procedures,  and  in  providing  well -documented  technical  information  on  AF  air 
and  ground  equipment. 

This  research  considers  the  design  of  an  effectiveness  planning  and 
evaluation  model  for  use  by  Air  Force  maintenance  organizations  at  the  wing  and 
squadron  levels.  The  model  is  intended  for  use  in  (1)  planning  maintenance 
activity  requirements  on  selected  end-item  equipments,  as  part  of  life-cycle 
staffing  and  costing,  and  (2)  evaluating  the  performance  of  a  maintenance 
organization  at  a  point  of  time  and  highlighting  areas  for  improvement. 

During  the  summer  period  1978,  initial  phases  of  this  research  were  con¬ 
ducted  by  the  author  while  participating  in  a  USAF/ASEE  Summer  Faculty  Fellowship 
at  the  Air  Force  Human  Resources  Laboratory,  Advanced  Systems  Division,  Wright- 
Patterson  AFB,  Ohio.  The  summer  work  included  an  extensive  literature  review  of 
previous  studies  and  proposals  concerning  the  selection,  training  and  perfor¬ 
mance  of  Air  Force  maintenance  personnel.  Factors  uncovered  in  the  literature 
search  were  then  developed  into  A  Taxonomy  of  Air  Force  Maintenance  Manpower 
Effectiveness  as  shown  in  Table  1.  It  may  be  noted  that  the  taxonomy  is  divided 
into  four  major  categories:  (1)  Equipment  Reliability/Maintainability  factors, 
(2)  Maintenance  Equipment  and  Technical  Information  factors,  (3)  Technician 
Experience,  Skill  and  Knowledge  factors,  and  (4)  Technician  Productivity  and 
Morale  factors.  The  subfactors  listed  in  the  Taxonomy  have  been  shown  to  have 
an  impact  on  either  (1)  the  performance  of  maintenance  technicians  (primarily 
AF  personnel)  or  (2)  the  morale  and  job  satisfaction  of  maintenance  technicians, 
in  one  or  more  research  investigations.  Reference  is  made  to  a  report  prepared 
for  AFHRL/ASD  at  the  end  of  the  summer  fellowship  by  the  author  (Young,  1978). 
References  included  in  the  Summer  1978  Design  Report  are  also  included  in  the 
Bibliography  of  this  Final  Scientific  Report. 

Three  studies  uncovered  in  the  literature  search  were  of  particular  interest 
to  this  author  and  suggested  a  possible  framework  for  modeling  the  performance 
of  an  AF  maintenance  organization.  The  first  research  study  was  an  attempt 
to  ascertain  what  equipment  design  and  operating  variables  affect  AF  main¬ 
tenance  performance,  using  survey  and  statistical  techniques  (Meister,  Finley 
and  Thompson,  1971).  The  study  covered  organizational  and  intermediate 
avionics  maintenance  of  two  autopilot  subsystems  in  the  B-52  and  KC-135  aircraft. 
Observations  were  made  involving  SAC  personnel  at  March  AFB  and  Wright-Patterson 
AFB  and  covered  performance  measures  of  time  to  perform  maintenance,  whether 
technical  orders  (manuals)  were  used  or  not  used,  the  number  of  unique  diagno¬ 
stic  checks  made  (in  trouble  shooting),  the  number  of  repeated  diagnostic 
checks  made,  the  number  of  components  removed  or  replaced,  the  technician's 
rating  of  task  difficulty,  the  number  of  times  assistance  was  required  by  the 
technician,  the  number  of  components  actually  worked  on,  the  maintenance 
diagnostic  strategy  used,  and  the  observer's  ratings  of  the  technician  relative 
to  understanding  the  problem  and  efficiency  of  work.  A  total  of  14  subjects 
were  included  in  the  study.  Table  2  summarizes  results  from  the  study  for 
performance  time  production.  The  values  stored  surfaced  as  significant  Beta 
coefficients  (predictors  of  time  to  perform  maintenance)  in  the  multiple 
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A  Taxonomy  of  Air  Force  Maintenance  Manpower  Effectiveness 
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Simmary  Statistics  from  Study  of  Maintenance  Job  Performance 
on  Two  Autopilot  Systems  (Compiled  from  Meister,  Finley,  and  Thompson,  1971) 
Performance  Time  Predictors  (Observation) 
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regression  analyses.  The  Meister  et  al.  study  did  not  include  motivational 
factors,  nor  was  accuracy  of  performance  used  as  a  criterion  measure. 

The  second  important  study  was  aimed  at  adapting  a  computerized  network 
simulation  model  known  as  SAINT  (Systems  Analysis  of  Integrated  Networks  of 
Tasks)  to  the  maintenance  task  performance  network  on  SRAM  missile  handling 
tasks  (Askren,  Campbell,  Seifert,  Hall,  Johnson  and  Sulzen,  1976).  Two 
performance  measures  generated  by  SAINT  were  then  compared  with  human  resources 
specialists.  Three  handling  tasks  in  organizational  maintenance  of  the  Short 
Range  Attack  Missile  (SRAM)  were  included  in  the  study  and  involved  120  main¬ 
tenance  technicians.  Dependent  variables  in  the  multiple  regression  analyses 
included  performance  time  estimates  and  performance  accuracy  (or  hazards) 
estimates.  Five  independent  variables  were  measured  from  survey  questions  or 
data  covering  (1)  system  proficiency  (as  measured  by  months  in  SRAM),  (2) 
quality  of  written  materials,  (3)  environment-temperature,  (4)  number  of  fatigue 
symptoms,  and  (5)  work  motivation.  Table  3  shows  some  results  from  the  study. 

A  further  analysis  of  the  results  was  made  by  the  author  in  Summer  1978  to 
show  the  percentile  contribution  of  each  of  the  five  independent  factors  towards 
prediction  of  performance  time  on  Task  29,  with  the  following  results:  (1) 
written  materials  -  35.4%,  (2)  work  motivation  -  25.5%,  (3)  environment  -  17.2%, 
(4)  proficiency  -  16.8%,  and  (5)  fatigue  symptoms  -  5.5%. 

The  third  and  perhaps  most  important  study  was  directed  towards  maintenance 
airman  characteristics  and  motivational  factors  which  contribute  to  the  speed 
and  accuracy  of  maintenance  task  performance  (Sauer,  Campbell,  Potter  and 
Askren,  1977).  The  survey-type  study  covered  140  missile  mechanics  and 
technicians  performing  organizational  maintenance  on  19  SRAM  MSET  tasks.  These 
are  tasks  subject  to  maintenance  standards  evaluation.  An  additional  90  techni¬ 
cians  working  on  the  AIR-2A  Genie  System  and/or  Minuteman  MKIII  reentry  vehicle 
were  included  in  the  opinion  survey.  Data  was  collected  at  five  AF  bases. 

The  dependent  variables  to  be  predicted  were  (1)  supervisor  ranking  of  techni¬ 
cian  overall  speed  of  task  performance,  (2)  supervisor  ranking  of  technician 
overall  accuracy  of  task  performance,  (3)  time  to  complete  task  as  entered  on 
MSET  evaluation  report  (the  latter  data  was  too  sketchy  to  be  useful).  Results 
of  the  study  are  summarized  in  Tables  4  and  5.  In  Sumner  1978,  the  author  further 
summarized  the  Sauer  et  al .  results  to  provide  the  information  shown  in  Table  6. 
The  top  portion  of  the  table  shows  the  weighted  priority  of  the  prediction 
variables  relative  to  time  to  perform  task. 

8ased  on  the  Summer  1978  review,  it  was  concluded  by  the  author  that  the 
single  most  important  "equipment/ information"  predictor  of  performance  rate 
(or  conversely  time  to  perform)  is  the  adequacy  and  completeness  of  the 
technical  information  provided  to  the  technician  and  that  the  "human  resources" 
predictors  of  most  importance  are  (1)  technician  motivation,  (2)  organization 
climate  and  group  morale,  (3)  months  in  career  field,  and  (4)  assignment  locality. 
For  accuracy  of  performance,  the  human  resource  predictors  which  appear  to  be 
most  important  are  (1)  technician  motivation,  (2)  assignment  locality,  (3) 
months  in  career  field,  and  (4)  pay  and  benefits  satisfaction.  Other  important 
findings  from  the  literature  review  are  summarized  in  Appendix  A. 


Objectives  and  Scope  of  Research 

This  research  is  aimed  primarily  at  the  human  resources  factors  which 
affect  job  performance.  However,  technician  supervisors  are  asked  to  provide 
a  limited  amount  of  information  about  equipment  and  technical  information  factors 
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Table  3 

Comparison  of  Performance  Time  Curves 
as  Estimated  by  13  Human  Resources  Raters  and 
i  as  Generated  by  SAINT  Computer  Simulation 

(Compiled  from  Askren,  Campbell,  Seifert,  Hall, 
Johnson,  and  Sulzen,  1976) 


A.  Performance  Times  vs  Number  of  Fatigue  Symptoms  for  SRAM  Missile  Handling  Task  27 

(Load  Launcher  to  Aircraft) 


Number  of 
Fatigue  Symptoms 

Mean  Subjective  Time  Estimates 
of  13  Raters  (Minutes) 

Computer  Generated  Times 
Usinq  SAINT  Simulation 

0 

54.6 

59.9 

5  Baseline 

63.6 

61.1 

10 

72.6 

62.7 

15 

81.6 

20 

90.6 

65.7 

25 

99.6 

30 

108.6 

68.8 

B.  Performance  Times  vs  Environment  (Temperature)  on  Three  Tasks  on  SRAM  Missile 


Temperature 

Conditions 

Task  2  (Transport)1 2 

Task  27 

2 

(Assemble) 

Task  29 

(Checkout)3 

Raters 

Simulation 

Raters 

Simulation 

Raters 

Simulation 

-40°F 

22.6 

15.7 

114.0 

70.7 

483.6 

271.3 

0° 

18.3 

15.0 

87.6 

66.0 

358.8 

265.5 

40° 

14.8 

14.3 

66.0 

62.0 

275.6 

261.4 

60°  Baseline 

14.2 

14.2 

61.8 

61.1 

260.0 

260.7 

O 

o 

o> 

15.1 

14.4 

68.4 

62.2 

291.2 

261.9 

120° 

19.3 

15.2 

96.0 

67.1 

397.8 

266.6 

1.  Task  2  -  Transport  Payload  to  IMF,  463x0  crew.  Mean  Time  140  Minutes 

2.  Task  27  -  Load  Launcher  to  Aircraft,  462x0  Crew,  Mean  Time  60  Minutes 

3.  Task  29  -  Perform  Aircraft  System  Checkout,  316x0  Crew,  Mean  Time  260 

Minutes 


Table  4 


Statistical  Results  on  Factors  Affecting  Maintenance 
Performance  Speed  Based  on  Data  Collection  Across 
140  SRAM  Technicians  AFSC  462x0  and  463x0 
(Compiled  from  Sauer,  Campbell,  Potter,  and  Askren,  1977) 


Significant  High  Performance  Variable 
and  Multiple  Regr.  Coefficients 
462xO(B33. 1879)  463x0(B70.8817) 

Correlation  Coefficients 
Correl.  R’s  >  0.25 
j  462x0  4f3x0 

Years  of  Service 

I 

.2168 

1  .28  (.17) 

Months  in  Career  Field 

.25  .29 

No.  of  Individual  Sports 

!  .28 

No.  of  Service  Clubs 

.2132 

!  .25 

No.  of  Interest  Clubs 

.1702 

.3109 

.26  (-.01) 

Trait  Anxiety  Level 

!  -.36  -.32 

Gordon  Personal  Pro.'ile 

i 

i 

Sociability  trait 

i  -.27 

Emotional  stability 

.30 

Ascendency  trait 

.2218 

.28 

Fatigue  Symptoms-Trait 

-.3193 

-.41 

Fatigue  Symptoms-State 

-.29  -.26 

Occupational  Opinion 

1 

AF  policy/practices 

.43 

Assignment  locality 

.1933 

.35  .43 

Social  status 

.36 

Organizational  Climate 

Structure 

.3272 

(.09) 

Risk 

-.2241 

(-.11) 

Warmth 

1 

.27 

Conflicts 

-.3353 

(.07) 

Group  Morale 

Satis,  indiv.  motives 

.34  .29 

Homogeneity  of  att. 

.2456 

.30  .27 

Satis,  interpersonal  rel, 

.34 

Satis,  with  leader 

.33 

LBDQ 

Persuasiveness 

.28 

Consideration 

-.4230 

(.15) 

Motivation 

Job  curiosity  trait 

HP(.Ol) 

HP(.01) 

.37  .53 

Persistence  trait 

HP(.Ol) 

.6173  HP(.01) 

.31  .61 

Prof,  identification 

HP(.Ol) 

HP(.01) 

.29  .42 

Team  attitude 

HP(.01) 

.41 

Org.  identification 

HP(.01) 

.32  .38 

Self-starter  trait 

.43 

Table  5 


Statistical  Results  on  Factors  Affecting  Maintenance  Performance 
Accuracy  Based  on  Data  Collected  Across  140  SRAM  Technicians 
(Compiled  from  Sauer,  Campbell,  Potter,  and  Askren,  1977) 


Predictor 

Significant  High 
and  Multiple  Re 
462x0(814.3824) 

Performer  Variables 
gr.  Coefficients 
|  463x0(Bl 3 . 531 6) 

Correlation 
Correl .  R 
462x0 

Coefficients 
's  >  .25 
¥63x0 

Years  of  Service 

.34 

No.  of  Re-enlistments 

.26 

Months  in  Career  Field 

.32 

No.  of  Interest  Clubs 

.1991 

.32 

1 

i 

No.  of  Indiv.  Sports 

.1588 

j  (.18) 

Gordon  Personal  Profile: 

| 

Responsibility  trait 

.29 

Fatigue  Symptoms-Trait 

**  HP(.01) 

-.40 

Fatigue  Symptoms-State 

-.26 

LBDQ: 

Representation 

-.36 

Tolerance  of  freedom 

.26 

Occupational  Opinion 

AF  policy/practices 

**  HP(.01) 

.27 

Assignment  locality 

**  .3540-HP( .01 ) 

.39 

Pay  and  benefits 

-.2338 

(.18) 

Promotion  opportunity 

**  HP(.01) 

.28 

Organization  Climate 

Responsibility 

-.29 

Rewards 

-.3263 

(.06) 

Warmth 

.29 

Group  Morale 

Satis,  indiv.  motives 

*  .3817  HP ( .001 ) 

.41 

Homogeneity  of  attitude 

.32 

Satis,  with  leader 

-.3111 

Motivation 

Job  curiosity  trait 

**  .8249-HP( ,01 ) 

★★ 

HP(.01) 

.46 

.57 

Persistence  trait 

**  HP(.01) 

** 

.7897  HP(.01) 

.37 

.71 

Prof,  identification 

**  HP(.01) 

** 

HP(.01) 

.32 

.51 

Team  attitude 

**  HP(.01) 

★★ 

HP ( . 01 ) 

.50 

Organ,  identification 

**  HP ( .01 ) 

*★ 

HP(.01) 

.37 

.45 

Self-starter  trait 

**-.4368  HP (.01) 

irk 

HP(.01) 

.54 

*  Significant  at  { p< . 001 )  for  high  performers 


**  Significant  at  ( p< . 01 )  for  high  performers 
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Prioritized  Predictive  Factors  for  Time  to  Perform  Five 
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which  may  also  be  expected  to  impact  on  performance.  In  total,  forty-eight 
predictor  variables  were  eventually  included  in  the  performance  model.  The 
two  dependent  variables  selected  were  technician  performance  rate  and 
technician  performance  accuracy,  as  judged  by  a  first  line  or  immediate 
supervi sor. 

The  specific  objectives  and  scope  of  the  research  are 

(1)  to  develop  one  or  more  survey  instruments,  using  existing  and  pre¬ 
validated  questions  when  possible,  for  gathering  data  from  AF 
maintenance  technicians  and  their  supervisors  that  might  be  pre¬ 
dictive  of  technician  performance  (herein  defined  as  some  combination 
of  speed  and  accuracy  of  work), 

(2)  to  develop  a  rating  instrument  by  which  first  line  (immediate)  super¬ 
visors  could  compare  technicians  performance  and  establish  performance 
ratings, 

(3)  to  secure  Air  Force  clearance  for  conduct  of  extensive  surveys  of 
maintenance  personnel  at  Williams  AFB  and  Luke  AFB ,  Arizona,  using  the 
developed  survey  and  rating  instruments, 

(4)  to  conduct  the  surveys  at  the  two  AF  bases, 

(5)  to  summarize  the  survey  data,  including  supervisory  ratings,  from  each 
of  the  two  bases  and  prepare  the  data  for  statistical  analyses, 

(6)  to  subject  the  data  from  each  base  to  extensive  statistical  treatment 
as  a  means  of  generating  useful  predictive  models  of  maintenance 
squadron  technician  performance, 

(7)  to  examine  similarities  and  differences  between  the  predictive  models 
for  differing  AF  maintenance  squadrons,  and 

(8)  to  develop  conclusions,  make  recommendations  for  future  work,  and 
write  and  publish  the  results  of  the  study. 

The  long-run  objectives  of  the  research,  of  which  this  grant  and  research 
are  a  first  step,  is  to  standardize  on  a  set  of  survey  instruments  and  rating 
scales  which  (1)  would  permit  an  AF  Wing  or  squadron  to  periodically  examine 
its  performance  effectiveness  and  (2)  would  permit  the  U.S.  Air  Force  to  more 
accurately  predict  maintenance  requirements  on  selected  end-item  equipments 
for  life-cycle  staffing  and  costing. 


RESEARCH  EFFORTS  AND  RESULTS 


At  the  proposal  stage  of  this  research,  a  performance  effectiveness  model 
was  postulated  with  the  following  dependent  and  Independent  variables: 

(1)  Average  technician  performance  rate  (or  speed  of  work)  across  a 
squadron,  a  dependent  variable  to  be  predicted.  For  purposes  of 
experimentation,  supervisor  ratings  of  technician  performances  would 
be  used. 
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(2)  Average  technician  performance  accuracy  (or  quality  of  work)  across 
a  squadron,  a  dependent  variable  to  be  predicted.  For  purposes  of 
experimentation,  supervisor  ratings  of  technician  performances  would 
be  used. 

(3)  Average  weight  of  subsystems  or  components  handled  by  technicians 
within  the  squadron,  a  predictor  variable  averaged  from  supervisor 
estimates  for  each  supervisory  work  group  (normally  a  shift  work  group). 

(4)  Average  difficulty  of  servicing  assigned  subsystems,  across  the 
squadron,  based  on  accessibility  or  clearance  for  such  tasks.  A  pre¬ 
dictor  variable  based  on  supervisor  estimates  for  each  work  group. 

(5)  Average  difficulty  of  removing  and/or  replacing  subsystems  (or  compo¬ 
nents),  across  the  squadron,  based  on  the  accessibility  or  clearance 
for  such  tasks.  A  predictor  variable  based  on  supervisor  estimates 
for  each  work  group. 

(6)  Average  number  of  internal  components  in  subsystems  serviced,  across 
the  squadron,  based  on  supervisor  estimates  for  each  work  group. 

(7)  Operating  hours  between  services  for  equipment  subsystems,  across  the 
squadron,  based  on  supervisor  estimates  for  each  work  group. 

(8)  Adequacy  of  technical  information  available  to  technicians,  across  the 
squadron,  based  on  supervisor  estimates  for  each  work  group. 

(9)  Usability  of  the  available  test  equipments,  across  the  squadron,  based 
on  supervisor  estimates  for  each  work  group. 

(10)  Average  knowledge  of  technicians  for  performing  servicing  requirements, 
across  the  squadron,  based  on  supervisor  estimates  for  each  work  group. 

(11)  Average  skills  of  technicians  in  performing  servicing  requirements, 
across  the  squadron,  based  on  supervisor  estimates  for  each  work  group. 

(12)  Average  (mean)  shift  assignment,  across  the  squadron,  based  on 
technician  inputs. 

(13)  Mean  year  of  enlistments  into  the  Air  Force,  across  the  squadron, 
based  on  technician  Inputs. 

(14)  Mean  skill  level  of  technicians,  across  the  squadron,  based  on 
technician  inputs  [3, 5, 7, 9  levels]. 

(15)  Mean  year  of  assignment  to  current  duty  status,  across  the  squadron, 
based  on  technician  inputs. 

(16)  Mean  year  of  assignment  to  current  equipment  type,  across  the  squadron, 
based  on  technician  Inputs. 

(17)  Average  number  of  months  on  current  equipment  assignment,  based  on 
technician  inputs. 

(18)  Mean  of  sex  distribution  (where  0  ■  female  and  1  *  male),  across  the 
squadron,  based  on  technician  Inputs. 
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(19)  Average  complexity  level  of  aircraft  or  missile  equipment  (based  on 
analysis  and  using  an  interval  scale),  across  the  squadron,  based 
on  technician  inputs. 

(20)  Average  military  rank  (or  civilian  grade),  across  the  squadron,  based 
on  technician  inputs  [1  =  military  and  2  =  civilian]. 

(21)  Average  number  of  sequential  work  days  between  days-off-periods  (weekend 
or  other),  across  the  squadron,  based  on  technician  inputs. 

(22)  Average  number  of  additional  duties  assigned  to  maintenance  technicians, 
across  the  squadron,  based  on  technician  inputs. 

(23)  Average  number  of  hours  worked  per  work  shift,  across  the  squadron, 
based  on  technician  inputs. 

(24)  Average  hours  per  week  spent  on  addi tonal  assigned  duties,  across  the 
squadron,  based  on  technician  inputs. 

(25)  Average  number  of  clubs  in  which  technicians  particpate,  across  the 
squadron,  based  on  technician  inputs. 

(26)  Average  number  of  persons  supervised  by  technicians  (including  0), 
across  the  squadron,  based  on  technician  inputs. 

(27)  Average  number  of  months  technicians  have  served  as  a  supervisor,  across 
the  squadron,  based  on  technician  inputs. 

(28)  Average  technician  satisfaction  with  squadron  and  work  group  in  meeting 
individual  motives  of  technicians,  across  the  squadron,  based  on 
responses  to  series  of  questions. 

(29)  Average  technician  satisfaction  with  supervision  received,  across  the 
squadron,  based  on  responses  to  a  series  of  questions. 

(30)  Average  technician  expressions  concerning  the  homogeneity  of  attitude 
within  the  squadron  and  work  group,  across  the  squadron,  based  on 
responses  to  a  series  of  questions. 

(31)  Average  technician  satisfaction  with  interpersonal  relationships  among 
peers  within  the  squadron  and  work  group,  across  the  squadron, 

based  on  responses  to  a  series  of  questions. 

(32)  Average  technician  expressions  concerning  the  organizational  structure 
of  the  squadron  and  work  group,  across  the  squadron,  based  on 
responses  to  a  series  of  questions. 

(33)  Average  technician  expressions  concerning  the  organization  warmth  of 
the  squadron  and  work  group,  across  the  squadron,  based  on  responses 
to  a  series  of  questions. 

(34)  Average  technician  expressions  concerning  the  organizational  rewards 
of  the  squadron  and  work  group,  across  the  squadron,  based  on 
responses  to  a  series  of  questions. 
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(35)  Average  technician  expressions  concerning  organizational  risks 
within  the  squadron  and  work  group,  across  the  squadron,  based  on 
responses  to  a  series  of  questions. 

(36)  Average  technician  expressions  concerning  organizational  conflicts 
within  the  squadron  and  work  group,  across  the  squadron,  based  on 
responses  to  a  series  of  questions. 

(37)  Average  technician  expressions  concerning  organizational  identity 
with  the  squadron  and  work  group,  across  the  squadron,  based  on 
responses  to  a  series  of  questions. 

(38)  Average  technician  expressions  concerning  their  current  assignment 

1  oca! i ty  (and  AF  Base),  across  the  squadron  based  on  responses  to  a 
series  of  questions  (AF  personnel  only). 

(39)  Average  technican  expressions  concerning  their  current  pay  and 
benefits,  across  the  squadron,  based  on  responses  to  a  series  of 
questions  (AF  personnel  only). 

(40)  Average  technician  expressions  concerning  their  current  social  status 
within  the  Air  Force,  based  on  responses  to  a  series  of  questions 
(AF  personnel  only). 

(41)  Average  fatigue  trait  of  technicians,  across  the  squadron,  based  on 
their  responses  to  a  series  of  possible  identifiers. 

(42)  Average  ascendency  trait  of  technicians,  across  the  squadron,  based 
on  their  responses  to  a  series  of  identifiers. 

(43)  Average  responsibility  trait  of  technicians,  across  the  squadron, 
based  on  their  responses  to  a  series  of  identifiers. 

(44)  Average  emotional  stability  trait  of  technicians,  across  the  squadron, 
based  on  their  responses  to  a  series  of  identifiers. 

(45)  Average  sociability  trait  of  technicians,  across  the  squadron,  based 
on  their  responses  to  a  series  of  identifiers. 

(46)  Average  .lob  curiosity  trait  of  technicians  across  the  squadron,  based 
on  supervisor  evaluations  of  technicians  within  each  work  group. 

(47)  Average  persistence  trait  of  technicians,  across  the  squadron,  based 
on  supervisor  evaluations  of  technicians  within  each  work  group. 

(48)  Average  professional  identification  trait  of  technicians,  across  the 
squadron,  based  on  supervisor  evaluations  of  technicians  within  each 
work  group. 

(49)  Average  organizational  identification  trait  of  technicians  across  the 
squadron,  based  on  supervisor  evaluations  of  technicians  within  each 
work  group. 

(50)  Average  self-starter  trait  of  technicians,  across  the  squadron,  based 
on  supervisor  evaluations  of  technicians  within  each  work  group. 

Thus  the  model  Included  48  predictor  variables  and  two  dependent  variables: 
speed  of  technician  performance  and  accuracy  of  technician  performance.  The 
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reader  may  have  recognized  from  the  above  list  of  factors  that  certain  well 
known,  existing  and  validated  survey  instruments  provide  information  for 
some  of  the  factors  and  led  to  their  inclusion.  The  Glossary  of  Terms  section 
at  the  beginning  of  this  report  further  defines  some  of  the  above  characteri¬ 
stics  . 


Development  of  the  Survey  Instruments 

the  predictor  factors  (or  variables)  included  in  the  modeling  effort 
resulted  from  one  or  more  of  three  conditions: 

(1)  The  factor  was  a  significant  predictor  of  maintenance  technician 
performance  rate  or  technician  performance  accuracy  in  some  previous 
research  study  (military  and  nonmilitary  systems). 

(2)  The  factor  was  suggested  in  the  literature,  or  by  one  or  more  of 
several  Air  Force  maintenance  officers  interviewed,  as  relating  in  an 
important  way  to  maintenance  technician  performance  and  should  be 
worthy  of  study. 

(3)  A  measurement  instrument  exists,  or  is  easily  developed,  for  gathering 
data  on  the  factor. 

All  of  the  48  predictor  variables  initially  proposed  were  included  in  the 
survey  instruments  developed.  It  was  decided  to  separate  the  data  collection  into 
three  independent  survey  instruments,  one  of  which  would  be  completed  by  each 
selected  maintenance  technician  and  two  of  which  would  be  completed  by  the 
first  line,  immediate  shift  supervisor  of  each  technician.  The  three  survey  in¬ 
struments  developed  are  shown  in  Appendix  8. 

The  selection  of  the  performance  measure  or  measures  to  be  used  in  the 
study,  as  well  as  the  methodology  of  measurements,  required  careful  study.  The 
writer  was  aided  in  this  investigation  by  Captain  Joel  R.  Hickman,  USAF,  who 
undertook  a  graduate  student  project  on  this  topic  in  partial  fulfillment  of 
the  requirements  for  a  master's  degree  from  Arizona  State  University  in 
Industrial  and  Management  Systems  Engineering.  The  performance  measure  or 
measures  would  be  the  dependent  variable(s)  in  the  modeling  effort.  Certain 
portions  of  the  following  section  are  taken  directly  from  or  are  summarized  from 
the  Hickman  project  report  (Hickman,  1979). 


Selection  of  the  Performance  Measures  and  Measurement  System.  Several  evaluation 
schemes  or  rating  schemes  were  investigated  which  purport  to  measure  the  perfor¬ 
mance  of  skilled  workers.  The  purpose  of  the  investigation  was  to  select  or 
develop  a  method  for  evaluating  and  measuring  the  performance  of  aircraft  and 
missile  maintenance  technicians  in  the  United  States  Air  Force.  Criteria 
developed  for  the  performance  measurement  scheme  may  include: 

(1)  Be  useful  for  describing  performance  to  management. 

(2)  8e  valid  as  a  measurement  of  maintenance  technician  performance. 

(3)  Be  applicable  to  different  types  of  performance  tasks  such  as  repair, 
service,  and  preventive  maintenance. 
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(4)  Be  applicable  to  military  and  civilian  employees  of  the  Air  Force. 

(5)  Provide  a  performance  measure  throughout  the  many  levels  of  weapon 
systems  maintenance. 

(6)  Provide  valid  information  for  statistical  analysis  in  the  form  of 
normal  performance  distributions  with  constant  variance. 

(7)  Meet  time  and  cost  limitations  for  use  of  the  evaluation  methodology. 

Techniques  for  performance  measurement  were  evaluated  in  terms  of  (1)  organiza¬ 
tion  structure,  (2)  the  quality  of  ratings,  (3)  the  above  list  of  performance 
criteria,  (4)  the  appraisal  methods,  (5)  rating  scale  errors,  (6)  scale  format 
and  (7)  the  raters. 

One  of  the  restrictions  on  the  performance  measure  used  is  that  it  be 
applicable  to  different  types  of  aircraft  maintenance  performed  at  different 
organizational  levels.  This  is  a  difficult  restriction  to  satisfy  as  the  Air 
Force  maintenance  structure  involves  thousands  of  personnel  performing  a  vast 
variety  of  functions.  McDonnell  (1979)  reports  that  there  are  forty-five 
thousand  Air  Force  members  in  the  aircraft  maintenance  field  alone. 

Maintenance  is  concerned  with  aircraft  and  missiles  and  is  performed  by 
military  or  civilian  technicians  of  both  sexes.  The  three  overall  levels  of 
maintenance  organization  are  known  as  base  or  organizational,  intermediate,  and 
depot.  Base  level  maintenance  consists  of  inspecting,  servicing,  and  replacing 
parts.  Intermediate  level  maintenance  is  often  indistinguishable  from  base  level 
maintenance  and  consists  of  calibrating  or  replacing  damaged  or  unserviceable 
parts,  of  modifying  material,  and  of  emergency  manufacturing  of  unavailable 
parts.  Depot  level  maintenance  augments  stocks  of  serviceable  material  with  more 
extensive  shop  facilities  and  personnel  of  higher  technical  skill  level  (usually 
civilian  employees). 

Further  generality  of  the  rating  technique  is  mandated  by  the  varied  tasks 
performed  by  a  base  level  maintenance  organization.  A  typical  Air  Force 
base  with  a  mission  involving  aircraft  might  include  field  maintenance  (FMSQ), 
organizational  maintenance  (OMSQ),  avionics  maintenance  (AMSO),  and  munitions 
maintenance  (MMSQ)  squadrons.  Meister,  Finley,  and  Thompson  (1971),  Foley  (1974), 
and  Wiley  (1978)  have  considered  automatic  flight  control  maintenance  performance 
in  the  AMSQ  alone,  while  Sauer,  Campbell,  Potter  and  Askren  (1977)  dealt  with 
Short  Range  Attack  missile  maintenance  in  the  MMSQ  alone.  Enlarging  the  scope 
of  a  performance  measurement  tool  to  include  avionics  repair,  fabrication,  pro¬ 
pulsion,  and  flightline  launch  and  recovery  personnel  requires  a  generalized 
rating  scale  or  scales  applicable  to  many  technician  specialities  or  specific, 
noncomparable  measures  for  each  specialty.  Separate  measures,  however,  would 
make  analysis  of  overall  performance  within  any  squadron  impossible. 

The  nature  of  the  maintenance  organization  strongly  favors  the  use  of 
general  individual  performance  measures.  Such  measures  would  be  applicable  to 
the  varied  tasks  and  functions  the  different  technicians  are  responsible  for. 

Since  most  maintenance  is  performed  by  teams  of  five  to  ten  technicians 
working  under  one  supervisor,  the  supervisor  could  evaluate  his  personnel  if  a 
general,  subjective  performance  measure  is  used.  The  structure,  size,  and 
complexity  of  the  Air  Force  maintenance  system  thus  requires  the  use  of  a  new 
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subjective,  and  general  performance  measurement  system  for  this  particular 
research  effort. 

Barrett  (1966:12)  feels  that  a  performance  measure  is  successful  only  if  it 
meets  three  standards: 

It  must  be  accepteable  to  the  people  who  use  it;  it  must  cover  what 

is  important  and  only  what  is  important;  and  a  systematic  examination 

of  the  results  of  ratings  must  show  that  they  are  reasonably  free  from 

important  defects. 

The  performance  data  which  will  eventually  be  used  to  develop  performance 
effectiveness  models  must  be  accepted  by  maintenance  managers  and  evaluators 
as  well  as  research  personnel.  The  easiest  way  to  gain  acceptance  might  be  to 
use  existing  measures  such  as  Airman  Performance  Ratings  (APRs)  or  merit 
ratings  for  civilian  personnel.  These  measures,  however,  are  used  for  admini¬ 
strative  purposes  of  promotion  and  wage  administration  and  not  for  developmental 
purposes.  McGregor  (1957)  and  Barrett  (1966)  warn  against  mixing  incompatible 
purposes  in  one  program,  as  management  is  placed  in  the  incompatible  role  of 
judge  and  counselor. 

If  a  new  performance  measure  is  developed  it  might  be  advisable  to  solicit 
the  opinions  of  managers,  using  surveys  or  limited  acceptance  tests  as  to 
criterion  acceptability. 

An  alternative  to  using  existing  measures  or  soliciting  manager  opinions 
as  to  acceptability  would  be  to  develop  criterion-referenced  test  measures.  A 
criterion-referenced  test  measures  what  an  individual  can  do,  or  knows, 
compared  to  what  he  must  be  able  to  do,  or  must  know,  in  order  to  complete  a 
task  successfully  (Glaser  and  Nitko,  1971:  Swezey  and  Pearlstein,  1975). 

Such  Cri teri on-Referenced  Job  Task  Performance  Tests  (JTPT)  were  experimentally 
developed  by  Foley  (1974)  for  electronic  maintenance  tasks  after  much  time 
and  effort.  Such  objective  tests  might  prove  to  be  more  acceptable  then  other 
subjective  performance  judgments  such  as  supervisors'  ratings. 

However,  acceptance  is  not  enough;  a  measure  that  omits  essentials  or 
gives  weight  to  trivia  is  defective.  Barrett  (1966)  feels  that  a  clear 
statement  of  the  objectives  of  the  ratings  is  the  first  step  while  Guion  (1965) 
believes  that  the  first  step  is  a  judgment  of  the  importance  of  the  concept 
being  developed.  Both  authors  agree  that  the  second  step  is  a  clear  statement 
of  what  the  job  requires  and  the  kinds  of  job  behavior  that  are  essential 
to  success.  As  Barrett  points  out,  punctuality  may  be  important  in  an 
automated  office  where  each  person's  performance  affects  his  neighbors,  but 
it  is  unrelated  to  the  success  of  a  door-to-door  salesman. 

Subjective  ratings  or  judgments  are  relied  upon  by  management  as  criteria 
for  validation  studies.  Guion  (1965:96)  reports  that  eighty-one  percent  of 
validation  studies  appearing  in  the  Journal  of  Applied  Psychology  and  Personnel 
Psychology  between  January,  1950,  and  July,  1955,  relied  upon  ratings. 

According  to  Barrett  (1966:33)  rating  scales  are  concerned  with  three 
kinds  of  concepts:  personality,  performance,  and  product.  Personality  is 
the  total  of  a  person's  characteristics .  It  includes  emotional  make-up, 
intelligence,  and  what  is  commonly  called  character.  Performance  has  to  do 
with  how  an  individual  goes  about  doing  work.  Included  are  working  hard. 
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following  instructions,  planning,  and  taking  responsibility.  Product  is  a 
person's  output.  The  quantity  and  quality  of  work  are  product. 

The  most  pertient  of  the  three  is  product.  Management  is  fundamentally 
interested  in  sales,  production  of  finished  goods,  and  other  factors  that  are 
visible  and  inherently  measurable.  Product  in  some  cases  can  be  measured 
directly  (objective  measurement)  and  in  other  cases  it  is  necessary  to  have  a 
rater  look  at  the  product  and  evaluate  its  quality.  Measures  of  product  often 
suffer  from  deficiency,  as  only  part  of  an  individual's  output  can  be  measured 
in  objective  terms.  They  may  also  be  contaminated  since  much  of  what  is  measured 
is  beyond  the  individual's  control;  for  example,  product  may  be  the  output  of 
many  individuals,  not  one  alone. 

Existing  ratings  of  individuals  employed  by  the  Air  Force  are  of  little 
value  except  for  administrative  purposes.  Airmen  Performance  Reviews  (APRs) 
are  inflated  according  to  Callander  (1979)  and  of  little  value  as  a  single 
performance  measure. 

If  products  are  not  available  for  evaluation,  the  rater  may  evaluate  how 
the  employee  goes  about  his  work  instead  of  what  he  produces.  Though  not  as 
objectively  measured  as  products,  these  job  performance  characteristics  are  both 
ratable  and  important.  Studies  by  Barrett  (1966)  indicate  that  supervisors 
and  subordinates  are  quite  sensitive  to  performance,  agree  on  the  relative 
importance  of  performance  traits,  and  attach  a  great  deal  of  weight  to  the 
performance  style  used  on  the  job. 

In  this  case  it  appears  that  subjective  appraisals  are  most  applicable. 

There  are,  however,  many  potential  traits  that  could  be  used.  Lawler  (1967:371) 
indicates  that  it  is  easy  to  err  on  the  side  of  providing  too  many  traits  upon 
which  to  make  ratings.  Dunnette  (1963:252)  points  out  that  the  use  of  a  single 
criterion  is  unrealistic  while  Rush  (1953:23)  indicates  that  between  three  and 
five  criterion  factors  surface  in  factor-analysis  studies.  The  potential  size 
of  a  study  covering  Air  Force  maintenance  performance  mandates  the  use  of  as 
few  factors  as  possible-either  two  or  three. 

Lawler  (1967:371)  indicates  that  one  rating  that  probably  should  be  included 
is  one  on  quality  of  job  performance.  When  people  are  asked  to  make  such  general 
ratings  on  quality  they  act  in  a  very  predictable  way,  as  efficient  appraisers 
of  critical  incidentdata  from  their  observations  of  an  individual's  performance 
in  the  past. 

According  to  Locker  and  Teel  (1977:246),  conventional  ratings  constitute 
the  most  popular  form  of  appraisal  technique.  Rating  scales  generally  have 
several  statements  about  employee  characteristics  or  behavior.  A  continuous 
or  discrete  scale  is  established  for  each  item.  Figure  1  illustrates  several 
scaling  procedures  from  Cunnings  and  Schwab  (1973:90).  Item  A  is  scaled 
continuously:  the  evaluator  places  a  check  somewhere  on  the  scale  to  represent 
his  assessment  of  the  appraisee.  Item  B  has  a  numerical  discrete  scale 
although  letters  are  sometimes  used  instead  of  numbers.  Item  C  is  also  scaled 
discretely  with  adjectives.  Discrete  scales  generally  result  in  greater 
Interrater  agreement  and  hence  are  preferable  to  continuous  scales,  according 
to  Cummings  and  Schwab  (1973). 

Considerable  attention  has  been  paid  in  experimental  psychology  to  the 
problems  of  scaling  to  find  out  all  that  can  be  learned  about  man  as  a  measuring 
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instrument.  Experience  has  shown  that  certain  rules  are  favorable  to  effective 
graphic  ratings.  Guilford  (1954:267)  lists  the  following  rules. 

(1)  Each  trait  should  occupy  a  page  by  itself. 

(2)  The  line  should  be  at  least  five  inches  long,  but  not  much  longer. 

(3)  The  line  should  have  no  breaks  or  divisions. 

(4)  The  "good"  or  "high"  ends  of  the  lines  should  be  in  the  same  direction. 

(5)  For  unsophisticated  raters,  the  "good"  end  should  be  placed  first. 

(6)  Descriptive  phrases  or  cues  should  be  concentrated  as  much  as  possible 
at  points. 

(7)  Do  not  use  end  cues  so  extreme  in  meaning  that  they  will  never  be 
appl ied. 

(8)  Set  the  end  cues  at  a  little  distance  from  the  ends  of  the  line. 

(9)  In  scoring,  use  a  stencil  that  divides  each  line  into  sections  to 
which  numerical  values  are  assigned. 

It  appears  that  the  best  scale  format  would  follow  the  rules  listed  by 
Guilford.  The  rating  standards,  in  this  case,  should  be  based  on  comparisons 
with  other  technicians  within  a  particular  maintenance  squadron.  Using  two 
adjectives  to  anchor  the  ends  of  scales  for  quality  and  quantity  of  performance 
appraisal  serves  several  purposes:  (1)  the  term  "average"  is  avoided,  (2) 
generality  of  the  scale  is  maintained  to  make  it  applicable  to  many  maintenance 
activities,  (3)  the  possiblity  of  obtaining  a  normal  performance  distribution 
is  improved,  and  (4)  multimodal  distributions  grouped  around  descriptive 
adjectives  are  avoided.  The  use  of  ten  steps  is  familiar  to  the  raters  due  to 
the  similarity  with  Airman  Performance  Ratings  and,  since  interpersonal 
performance  is  being  rated,  allows  for  finer  distinctions  between  technicians. 

Based  on  previous  work  the  appraisal  forms  shown  in  Figures  2  and  3  were 
developed  and  included  in  the  survey  instruments.  They  should  provide  useful 
performance  information  for  valid  statistical  analysis. 


Generating  the  Three  Survey  Instruments.  The  three  survey  instruments  shown  in 
Appendix  B  may  now  be  discussed  more  fully.  The  first  instrument,  entitled 
Supervisors  Technical  Information  and  Performance  Rankings  Form,  has  two  parts, 
the  first  part  covers  technical  information  needed  from  the  supervisor  to  support 
predictive  factors  numbered  3  through  11.  Horizontal  interval  scales  were 
selected  foreach  question  with  verbal  descriptions  at  ends  of  the  scales.  Part 
2  contains  the  performance  ranking  scales  for  speed  and  quality  of  work,  in  which 
technicians  assigned  to  a  shift  supervisor  are  first  ranked  against  each  other 
and  then  rated  individually  on  a  1-10  scale  against  a  near  perfect  "10". 

The  second  instrument,  also  designed  for  supervisor  completion,  allows  the 
supervisor  to  evaluate  motivation  traits  of  each  particular  technician  included 
in  the  study.  The  Supervisors  Technician  Motivation  Evaluation  is  coupled 
externally  to  the  Maintenance  Technician  Survey,  as  part  of  the  data  for 
each  technician  selected  for  the  study.  One  form  is  completed  by  the  shift 
supervisor  for  each  of  the  technicians  (which  he  supervises)  that  are  selected 
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The  first  aspect  of  performance  we  are  interested  in  is  speed,  or  how  quickly  an  individual  accomplishes 
a  job.  To  rank  everybody  whom  you  supervise,  imagine  that  you  must  assign  one  individual  to  a  job  in  which 
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Figure  2  Rating  Scale  for  Speed  of  Performance 
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Figure  3  Rating  Scale  for  Accuracy  of  Performance 
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in  the  sample.  The  survey  instrument  uses  vertical  scales,  each  containing 
5  tic  marks,  with  a  "high"  description  at  the  top  of  the  scale  and  a  "low" 
description  at  the  bottom  of  the  scale.  The  scales  are  a  modification  of 
those  developed  by  Sauer  et  al .  and  used  in  a  previous  study  (Sauer,  Campbell, 
Potter  and  Askren,  1977).  The  motivation  traits  examined  include  (1)  job 
curiosity,  (2)  persistence,  (3)  professional  identification,  (4)  organizational 
identification,  and  (5)  self-starter  characteristics. 

The  third  instrument  is  the  Maintenance  Technician  Survey  and  is  completed 
by  each  of  the  technicians  selected  for  the  sample.  The  body  of  the  question¬ 
naire  consists  of  five  areas,  covering  (1)  group  morale,  (2)  organization 
climate,  (3)  occupational  attitude,  (4)  fatigue  trait  (feelings  while  working), 
and  (5)  personal  traits.  Each  cf  these  will  be  discussed  in  more  detail. 


Part  I.  Group  Morale.  The  Bernard  Goldman  Group  Morale  Scale  was  adapted 
for  this  part  of  the  survey  with  very  little  modification  (Goldman,  1958).  The 
scale  consists  of  20  questions  covering  the  following  four  factors: 

(1)  Group  support  of  individual  motives--questions  1,  8,  13,  and  18 
[4  items]. 

(2)  Group  homegenelty  of  attitude--questions  2,  7,  11,  15  and  16  [5  items]. 

(3)  Group  interpersonal  relationships--questions  3,  6,  9,  12,  14,  19, 

20  [7  items]. 

(4)  Satisfaction  with  supervision— questions  4,  5,  10  and  17  [4  items]. 

As  discussed  in  the  earlier  design  report  (Young,  1978),  pros  and  cons 
for  the  Goldman  Group  Morale  Scale  have  been  presented  in  the  literature. 

Further,  theffiS  dates  back  to  1958.  However,  it  is  this  author's  opinion 
that  the  GMS  is  still  a  useful  and  valuable  survey  instrument  and  that  the 
questions  are  well  adapted  to  the  survey  of  maintenance  technicians  with  a 
few  minor  changes  in  wording.  The  GMS  employs  a  four  category  answer  directory: 

A  -  Strongly  Agree,  B  -  Agree,  C  -  Disagree,  D  -  Strongly  Disagree. 


Part  II.  Organization  Climate.  This  section  of  the  survey  instrument  was 
derived  from  the  organization  Climate  Inventory  (Litman  and  Stringer,  1968). 

The  published  OCI  consists  of  50  items  and  covers  9  factors.  In  previous  Air 
Force  studies  which  used  the  OCI,  only  the  factors  of  (1)  organization 
structure,  (2)  organization  rewards,  (3)  organization  risk,  (4)  organization 
warmth,  (5)  organization  conflict  and  (6)  organization  identity  have  proven 
significant  as  predictors  of  technician  performance.  It  was  therefore  decided 
to  include  in  the  Maintenance  Technician  Survey  only  those  questions  which 
related  to  these  6  factors: 

(1)  Organization  structure— questions  21-28  [8  items]. 

(2)  Organization  rewards— questions  29-34  [6  items]. 

(3)  Organization  risk— questions  35-39  [5  Items]. 

(4)  Organization  warmth— questions  40-44  [5  items]. 
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(5)  Organization  conflict-questions  45-48  [4  items]. 

(6)  Organization  identity--questions  49-52  [4  items]. 

The  OCI  is  an  often  used  and  thoroughly  validated  survey  instrument.  It 
was  adapted  for  use  in  the  Maintenance  Technician  Survey  by  changing  words 
relating  to  organization  form.  The  same  response  categories  are  used  as  for 
Part  I. 


Part  III.  Occupational  Attitude.  A  survey  instrument  known  as  the 
Occupational  Attitude  Inventory  was  developed  for  the  U.S.  Air  Force  (Tuttle, 
Gould  and  Hazel,  1975).  The  instrument  is  specific  to  Air  Force  personnel; 
therefore,  civilian  technicians  (employed  by  the  Air  Force)  who  completed 
the  Maintenance  Technician  Survey  were  instructed  to  bypass  Part  III.  The 
original  OAI  consists  of  348  items  and  covers  26  factors.  The  only  factors 
which  have  shown  significance  in  past  research  on  Air  Force  maintenance 
technicians  are  (1)  assignment  locality,  (2)  pay  and  benefits,  and  (3)  social 
status.  Thus  the  questions  covering  these  3  factors  were  extracted  from  the 
OAI  for  direct  use  in  the  Maintenance  Technician  Survey: 

(1)  Assignment  locality— questions  53-69  [17  items]. 

(2)  Pay  and  benefits— questions  70-81  [12  items]. 

(3)  Social  status— questions  82-92  [11  items].1 

There  are  four  response  categories  which  are  (1)  very  satisfied,  (2) 
satisfied,  (3)  unsatisfied,  and  (4)  very  unsatisfied. 


Part  IV.  Feelings  While  Working  (Fatigue  Trait).  This  section  of  the 
Maintenance  Technician 'Survey  employs  a  series  of  response  indicators  to  a 
fatigue  trait  (Yoshitake,  1971).  The  items  include  some  word  modifications 
for  proper  interpretation  by  Air  Force  technicians.  The  factor  covered  by 
the  items  included  proved  significant  in  the  previously  referenced  study  by 
Sauer,  Campbell  et  al . 

(1)  Fatigue  Symptoms  (Trait)— Items  (indicators)  93-124  [32  items].  < 

Two  answer  categories  are  used:  (1)  does  describe  feelings  or  (2) 
does  not  describe  feelings. 


Part  V.  Personal  Traits.  For  this  part  of  the  Maintenance  Technician 
Survey,  the  Gordon  Personal  Profile  was  adapted  (Gordon,  1963).  The  GPP 
consists  of  18  set  of  4  descriptive  phrases,  each  set  being  identified  as  a 
tetrad.  Four  factors  are  covered: 

(1)  Ascendency— [18  items] 

(2)  Responsibili ty— [18  items] 


1.  Definition  of  terms  are  given  in  the  Glossary  at  the  beginning  of  the  report. 
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(3)  Emotional  stability--[18  items] 

(4)  Sociability--[18  items] 

Each  item  covers  all  four  factors.  The  writer  chose  to  use  only  the 
first  13  items,  in  order  to  limit  the  overall  questionnaire  to  150  questions. 
The  matrix  of  selection  response  categories  is  as  follows: 


Emotional 


Item 

Question 

Cat. 

Ascendency 

Responsibl i ty 

Stability 

Sociability 

1 

125 

126 

Most 

Least 

Sel  B 

Sel  C 

Sel  D 

Sel  A 

2 

127 

128 

Most 

Least 

Sel  0 

Sel  C 

Sel  B 

Sel  A 

3 

129 

130 

Most 

Least 

Sel  B 

Sel  D 

Sel  A 

Sel  C 

4 

131 

132 

Most 

Least 

Sel  C 

Sel  B 

Sel  D 

Sel  A 

5 

133 

134 

Most 

Least 

Sel  A 

Sel  D 

Sel  C 

Sel  B 

6 

135 

136 

Most 

Least 

Sel  D 

Sel  B 

Sel  C 

Sel  A 

7 

137 

138 

Most 

Least 

Sel  C 

Sel  A 

Sel  B 

Sel  D 

8 

139 

140 

Most 

Least 

Sel  A 

Sel  B 

Sel  D 

Sel  C 

9 

141 

142 

Most 

Least 

Sel  B 

Sel  C 

Sel  D 

Sel  A 

10 

143 

144 

Most 

Least 

Sel  A 

Sel  C 

Sel  B 

Sel  D 

11 

145 

146 

Most 

Least 

Sel  B 

Sel  D 

Sel  A 

Sel  C 

12 

147 

148 

Most 

Least 

Sel  B 

Sel  C 

Sel  D 

Sel  A 

13 

149 

150 

Most 

Least 

Sel  A 

Sel  C 

Sel  B 

Sel  D 

Scoring  on  the  Gordon  Personal  Profile  is  based  on  2  points  for  a  "most 
like"  selection,  1  point  for  no  selection,  and  0  points  for  a  "least  like" 
selection.  However,  this  writer  chose  to  use  a  +1,  0,  -1  scale  to  highlight 
the  null  position  across  the  13  Items  used.  Thus  an  average  score  of  "0"  on 
one  of  the  four  factors  would  indicate  a  mean  level  of  factor  response  wherein 
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the  "most  like's"  and  "least  like's"  cancelled  out  (or  the  factor  was  not 
indicated  as  a  "most  like"  or  "least  like"  in  the  13  items). 


Overall  Maintenance  Technician  Survey.  The  final  survey  instrument,  shown 
in  Appendix  B,  consists  of  ISO  questions,  covering  137  items  and  18  factors. 

In  addition,  the  requested  Biographic  Information  section  provides  input  for 
additional  factors  included  in  the  modeling  effort. 

The  Biographic  Information  section  of  the  Maintenance  Technician  Survey 
was  designed  to  col lect  occupational  information  on  the  airmen  completing  the 
survey  including  sex,  rank  cr  grade,  squadron  assigned,  AFSC's,  skill  level, 
equipment  assigned,  extracurricular  activities,  etc.  (see  Appendix  B).  For 
Privacy  Act  compliance,  the  name  of  the  technician  completing  the  questionnaire 
was  not  requested;  however,  a  survey  control  number  was  assigned  to  each 
technician  selected  for  the  survey  in  advance. 

The  opening  sheets  on  the  Maintenance  Technician  Survey  provide  the  source 
for  and  purpose  of  the  study,  note  the  USAf7  assigned  Survey  Control  Number, 
provide  the  necessary  Privacy  of  Information  statement,  and  give  instructions 
for  completion  of  the  survey. 


Conduct  of  the  Surveys 

As  will  be  detailed  later  in  this  report,  surveys  were  administered  by  the 
writer  and  student  associates  at  Williams  Field  AFB  and  Luke  AFB,  Arizona. 

Each  AFB  is  approximately  a  one-hour  trip  by  automobile  from  Arizona  State 
University,  Tempe,  Arizona,  where  this  modeling  study  was  conducted.  The 
Williams  Field  AFB  Survey  took  place  in  October  1979  and  the  Luke  AFB  survey 
in  November  1979,  each  survey  covering  approximately  a  3-week  period.  Clearance 
for  the  study  was  solicited  and  received  from  AFMPC/MPCYS  (Randolph  AFB), 
prior  to  conduct  of  the  surveys  and  survey  control  number  80-11  was  assigned. 
Clearances  for  the  study  were  also  received  from  Headquarters  Air  Training  Command 
(HQATC)  and  Headquarters  Tactical  Air  Conwand  (HQTAC),  based  on  requests  from  the 
AFHRL,  Advanced  Systems  Division,  Wright-Patterson  AFB,  Ohio.  Since  it  was 
elected  to  include  civilian  (civil  service)  USAF  employees  in  the  surveys, 
clearance  was  also  obtained  from  the  national  and  local  union  organizations. 


Selection  of  the  Sample  Populations.  In  the  early  stages  of  this  research, 
it  was  planned  to  pretest  the  developed  survey  instruments  for  construct  validity 
and  determination  of  sample  size  (based  on  response  variability).  However,  the 
constrained  time  span  (9  months)  for  the  study  and  the  time  necessary  to  obtain 
USAF  survey  clearance  finally  ruled-out  the  pretests.  Fortunately,  an  extensive 
portion  of  the  survey  instruments  were  incorporations  (with  minor  modifications) 
of  previously  developed  and  tested  instruments  and  items.  Further,  the 
independent  factors  included  in  the  study  had  shown  a  significant  relationship 
to  maintenance  technician  performance  in  one  or  more  previously  published  studies. 

The  final  choice  of  sample  size  and  selection  procedures  stemmed  from  (1) 
this  researcher's  view  of  an  acceptable  sample  size  based  on  previous  research 
experience,  (2)  practical  constraints  associated  with  conduct  of  the  surveys, 
and  (3)  the  maintenance  organizations  studied.  It  was  decided  to  include  180 
maintenance  technicians  in  the  survey  at  each  of  the  two  Air  Force  bases. 
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Since  the  selected  method  of  performance  measurement  involved  first  line 
supervisor  rankings  and  ratings  of  technicians,  it  was  also  decided  that  five 
technicians  should  be  rated  by  each  supervisor. 

Williams  Field  AFB  has  one  AF  Wing,  the  82nd  Training  Wing,  and  involves 
primarily  T37  and  T38  aircraft.  Maintenance  is  performed  by  two  squadrons: 
the  Organizational  Maintenance  Squadron  (OMS)  and  the  Field  Maintenance  Squadron 
( FMS ) .  For  the  Williams  study,  it  was  elected  to  randomly  draw  18  shift 
supervisors  from  each  of  the  two  squadrons.  Supervisors  with  less  than  4 
reporting  technicians  were  not  included  in  the  draw.  If  a  supervisor  selected 
in  the  draw  had  4  or  5  reporting  technicians,  each  of  these  reporting  technicians 
was  included  in  the  survey.  If  a  selected  supervisor  had  more  than  5  reporting 
technicians,  random  selection  was  made  of  5  technicians  to  be  included  in  the 
survey.  The  number  of  technicians  assigned  to  the  Williams  FMS  squadron  in 
October  was  500,  with  480  assigned  to  the  OMS  squadron.  Thus  the  selected 
sample  design  provided  approximately  the  following  percentages  of  the  maintenance 
squadron  personnel  (82nd  AF  Wing): 


Squadron 

Size 

Design  Sample  Size 

Sample  %  of  Population 

FMS 

500 

90 

18.0 

DMS 

480 

90 

18.6 

Shift  supervisors  were  drawn  randomly  across  all  three  shifts  and  all  shifts  are 
represented  in  the  sample.  Technicians  reporting  to  several  of  the  selected 
supervisors  were  both  military  and  civilian,  and  of  both  sexes. 

Luke  AFB  has  two  AF  Wings;  the  405th  Tactical  Wing  was  selected  for  the 
survey  study  and  involves  primarily  FI 5  aircraft.  The  maintenance  organization 
is  defined  as  a  Production-Oriented  Maintenance  Organization  (POMO)  and  includes 
three  squadrons:  Aircraft  Generation  (AGS),  Component  Repair  (CRS)  and 
Electrical  Maintenance  (EMS).  Similar  procedures  to  that  used  at  Williams  AFB 
were  applied  in  selecting  the  survey  sample  from  the  Luke  405th  Wing.  Twelve 
shift  supervisors  were  to  be  randomly  drawn  from  the  list  of  shift  supervisors 
in  each  squadron,  and  for  supervisors  having  more  than  5  reporting  technicians, 
a  random  draw  was  to  be  made  of  the  5  technicians  to  be  included  in  the  study. 
Because  of  researcher  transportation  difficulties,  only  the  day  and  swing  shifts 
were  included  in  the  Luke  study  and  thus  all  mid-shift  supervisors  were  excluded 
from  the  draw.  Further,  some  shift  supervisors  were  on  temporary  duty  assignments 
and  were  not  available.  For  these  and  other  easons,  the  selection  of  shift 
supervisors  for  the  sample  was  less  random  at  Luke  AFB  than  at  Williams  AFB.  The 
selected  sample  design  provided  approximately  the  following  percentages  of  the 
maintenance  squadron  personnel  (405th  AF  Wing): 


Squadron 

Size 

Oesign  Sample  Size 

Sample  %  of  Population 

AGS 

800 

60 

7.5 

CRS 

463 

60 

13.0 

EMS 

330 

60 

18.2 
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The  writer  feels  that  the  selected,  stratified  sample  design  is  appropriate 
for  this  type  of  research  study  in  which  comparative  performance  judgments  must 
be  made  by  supervisory  personnel.  The  shift  supervisors  work  most  closely 
with  the  maintenance  technicians  and  are  best  able  to  judge  their  performances. 

In  most  cases,  the  supervisory  work  groups  included  between  5  and  10  technicians. 
Some  thought  was  given  to  also  having  the  technicians  selected  for  the  study 
rated  by  the  second-level  supervisor  (shop  or  unit  supervisor).  This  procedure 
was  ruled  out,  however,  because  of  the  question  of  how  to  weight  the  performance 
ratings  at  two  levels  of  supervision.  All  random  draws  were  made  from  a  table 
of  4-place  random  digits. 


Conduct  of  the  Surveys 

At  each  of  the  two  AF  bases,  a  classroom  was  available  to  conduct  the  surveys. 
The  supervisor  surveys  were  conducted  first,  over  several  days,  followed  later 
by  the  surveys  of  selected  technicians.  All  surveys  were  conducted  in  the  class¬ 
room,  after  brief  oral  instructions,  and  questionnaires  were  collected  as  partici¬ 
pants  completed  their  input  and  left  the  room.  To  minimize  interference  with 
work  requirements  of  the  maintenance  squadrons,  it  was  necessary  to  have  multiple 
survey  sessions  at  each  base  for  both  shift  supervisors  and  the  technicians. 

Maximum  attendance  at  any  session  was  approximately  20,  with  a  minimum  of  2. 

The  writer  was  assisted  in  the  survey  at  Williams  AFB  by  USAF  Captain  Joel 
R.  Hickman,  a  graduate  student  on  temporary  AFIT  assignment  to  Arizona  State 
University,  and  USAF  Captain  Jerry  Raney  of  the  Williams  AFB  maintenance  organi¬ 
zation.  At  Luke  AFB,  the  writer  was  assisted  by  Mr.  Mark  Bramlett,  a  graduate 
student  on  research  assignment  at  Arizona  State  University,  and  USAF  Captain 
Bob  Tilton  of  the  Luke  AFB  maintenance  organization.  All  survey  sessions  were 
supervised  by  one  or  more  of  the  above,  including  evening  and  early  morning  sessions 
for  swing-  and  mid-shift  personnel.  Needless  to  say,  this  involved  numerous 
round  trips  from  ASU. 

Supervisors  attending  the  early  round  of  survey  sessions  (for  supervisors 
drawn  in  the  samples)  were  given  a  list  of  5  of  their  reporting  technicians  who 
were  also  drawn  for  inclusion  in  the  study.  For  each  name  on  these  lists,  a 
technician  survey  control  number  was  also  assigned.  The  supervisors  were  instructed 
to  use  only  the  technician  survey  control  numbers  in  completing  the  Supervisors 
Technical  Information  and  Performance  Rankings  Form  and  the  Supervisors  Technician 
Motivation  Evaluation  questionnaires.  All  responses  were  to  be  placed  directly 
on  the  survey  instruments  (and  would  be  hand  scored).  Supervisors  were  permitted 
to  take  the  list  of  technicians  with  them  at  completion  of  the  session  so  that 
they  could  assign  the  technicians  to  report  to  the  classroom  for  completion  of  the 
Maintenance  Technician  Survey  during  the  multi  session  times  for  technician 
surveys.  Thus  a  supervisor  only  needed  to  part  with  one  of  his  reporting 
technicians  at  a  time,  for  a  period  of  approximately  one  hour. 

The  supervisor  survey  and  the  technician  survey  each  required  one  hour  or 
less  for  completion.  In  the  technician  survey  sessions,  instructions  were  given 
to  read  the  opening  material  and  complete  the  Biographic  Information  page  before 
preceding  to  the  survey  questions.  Only  one  technician,  of  all  surveyed  at  both 
AF  bases,  exercised  his/her  right  to  withdraw  from  the  survey.  A  few  other 
technicians  failed  to  show,  however,  even  after  extra  sessions  were  scheduled 
and  held.  In  general  response  was  excellent. 

Technicians  were  instructed  to  respond  to  the  150  question  survey  by  (1) 
entering  their  assigned  survey  control  number  (written  in  the  survey  booklet  and 
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also  on  a  machine  graded  response  form)  in  the  block  at  the  top  of  the  form 
for  machine  scoring,  and  (2)  enter  their  responses  to  the  150-question  survey 
on  the  machine  scoring  form.  A  copy  of  the  machine  scoring  form,  IBM  1230 
Document  No.  511,  is  included  in  Appendix  B.  The  form  has  response  fields  for 
exactly  150  questions.  Technicians  were  instructed  to  leave  the  heading  informa¬ 
tion  blank.  The  completed  form  as  developed  by  each  technician  was  inserted  in 
the  survey  booklet  when  submitted,  and  a  check  was  made  to  verify  the  survey 
control  number  (identification  number)  with  that  written  inside  the  survey  brochure. 


Processing  of  Data 

A  FORTRAN  IV  computer  program  was  developed  for  processing  the  input  data 
into  printed  output  information  and  a  set  of  punched  cards  with  data  prepared 
for  input  to  the  Biomedical  Data  Processing  Software  Package  known  as  BMDP1. 

The  program,  designed  to  run  data  for  one  squadron  at  a  time,  is  given  in 
Appendix  C  with  output  for  Williams  AFB,  FM  Squadron.  The  program  is  available 
on  punched  cards  and  on  a  magnetic  tape  file,  currently  set  up  on  the  Univac 
1142  Computing  System  at  Arizona  State  University.  The  program  is  designed  to 
include  Mapping  and  requires  1143  words  of  program  bank  and  95,  944  words  of 
data  bank  as  presently  constituted.  Data  dimensions  are  as  follows: 

(1)  Number  of  supervisors  per  squadron--up  to  20 

(2)  Number  of  technicians  per  squadron--up  to  200 

The  FORTRAN  program  utilizes  three  types  of  input  data,  corresponding  to 
the  three  survey  instruments  employed.  These  types  of  data  are  fully  documented 
in  the  program  and  may  be  summarized  as  follows: 

DATAl(I.J)  -  Inputs  from  the  Supervisors  Technical  Information  and  Perfor¬ 
mance  Rankings  Form,  Part  I.  The  five  technicians  reporting  to  each 
supervisor  are  first  identified  by  technician  survey  control  numbers; 
then  the  technical  information  data  of  Part  I  is  entered.  Coding  is 
by  hand  directly  from  the  survey  instrument.  Eventually,  this  data  is 
coupled  to  the  survey  data  for  each  of  the  5  reporting  technicians. 

J  is  the  supervisor  counter  (1-20)  and  I  is  the  number  of  field 
positions  needed  per  supervisor  (40  available,  15  used). 

DATA2(N,K)  -  Inputs  from  Part  II  of  the  Supervisors  Technical  Information 
and  Performance  Rankings  Form  (the  speed  and  quality  performance  ' 
rankings  for  each  technician),  the  Supervisors  Technician  Motivation 
Evaluation  form,  and  the  Biographic  Information  section  of  the 
Maintenance  Technician  Survey.  Coding  is  by  hand  from  the  survey 
instruments.  K  is  the  technician  counter  (1-200)  and  N  is  the  number 
of  field  positions  needed  per  technician  (56  available,  29  used  prior 
to  the  later  data  coupling  operations). 


1.  BMDP  (Biomedical  Data  Processing)  is  a  software  program  for  performing  stati¬ 
stical  evaluations  on  data,  developed  by  the  Department  of  Mathematics, 

School  of  Medicine,  University  of  California  at  Los  Angeles. 
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DATA3(I,J,K)  -  Input  from  the  150-question  Maintenance  Technician 
Survey,  which  is  machine  scored.  Four  input  data  cards  are  used 
for  each  technician's  data.  K  is  the  technician  counter  (1-200), 

J  allows  for  up  to  5  cards  per  technician  (  4  are  currently  used), 
and  I  is  the  number  of  field  positions  per  input  card  (72). 

The  technician  survey  control  number,  which  appears  on  each  of  the  three 
types  of  data  input  is  used  to  couple  all  data  to  each  particular  technician. 

First,  the  data  in  the  DATA1(I,J)  file  is  added  to  the  DATA2(N,K)  file  by 
technician.  Then  the  DATA3(I,j,K)  file  is  summarized  by  factor,  question 
responses  are  averaged  across  each  factor  and  the  factor  data  is  added  to 
DATA2(N,K).  After  coupling,  DATA2(N,K)  contains  all  of  the  appropriate  data 
for  each  technician  in  the  squadron,  for  a  total  of  56  fields  of  information. 

It  should  be  noted  here  that  the  150  questions  in  the  Maintenance  Technician 
Survey  result  in  only  18  predictor  variables  or  factors. 

Appendix  C  shows  an  example  run  of  the  FORTRAN  program  for  one  squadron, 
Williams  AFB,  FM  squadron.  It  may  be  noted  that  echo  checks  are  made  of  the 
input  data,  output  data  from  DATA2(N,K)  is  printed  following  data  collection,  and 
a  set  of  punched  cards  is  output  with  most  of  the  same  data,  prepared  for  use 
by  the  BMDP  statistical  package.  The  punched  card  output  is  on  2  cards,  each 
2513  format.  For  input  to  BMDP,  the  technician  number  is  unnecessary  and  the 
variables  of  squadron  code,  supervisor  code,  AFSC,  status  code  and  supervision 
code  were  considered  not  directly  pertiment  to  performance.  Thus  the  50 
variables  used  by  the  BMDP  package  are  as  shown  in  Figure  4,  using  appropriate 
letter  names. 

Output  decks  from  the  several  FORTRAN  data  processing  runs  (one  for  squadron) 
were  then  input  to  the  BMDP  statistical  package  and  in  particular  the  2R  stepwise, 
linear  multiple  regression  program.  For  each  squadron,  three  runs  were  initial¬ 
ized:  one  in  which  the  Performance  Speed  Rating  (A)  is  the  dependent  variable 
and  the  Performance  Quality  Rating  (B)  is  included  as  another  independent 
variable,  one  in  which  the  Performance  Quality  Rating  (B)  is  the  dependent 
variable  and  the  Performance  Speed  Rating  (A)  is  included  as  another  independent 
variable,  and  one  in  which  the  dependent  variable  is  a  weighted  transform  of 
the  two  performance  measures  and  neither  appear  as  an  independent  variable.  The 
latter  is  the  most  significant. 

Hickman  made  a  small  survey  of  senior  maintenance  officers  in  which  he  included 
questions  on  the  relative  importance  of  speed  vs.  accuracy  of  performance 
relative  to  current  Air  Force  mission  (Hickman,  1979).  The  results  favored 
accuracy,  at  least  in  peace  time,  over  speed,  though  both  were  considered  of 
importance.  This  writer  elected  to  weight  speed  by  0.4  and  accuracy  by  0.6  in 
developing  a  transformed  variable.  Thus  ZZ  =  0.4A  +  0.6B.  These  proportional 
weightings  are  elective.  For  a  summary  discussion  on  the  BMDP2R  program  see  the 
1977  Series  P  Manual  (University  of  California,  1977). 

Appendix  E  provides  an  example  output  from  the  BMDP2R  program,  for  the  FM 
squadron  at  Williams  AFB  when  the  transformed  variable  ZZ  =  0.4A  +  0.6B  is 
used  as  dependent.  The  punched  card  output  data  from  the  FORTRAN  program  is 
read  in  format  25F3.0/25F3.0.  One  variable  is  added  to  allow  for  the  ZZ 
transform.  Having  established  ZZ,  variables  A  and  B  are  deleted  by  using  only 
variables  3  through  51  in  the  analysis.  Printing  is  established  for  the 
covariance  matrix,  the  correlation  matrix,  the  input  data  distributions,  the 
step  analysis  of  variances  (ANOVA),  the  stepwise  regression  coefficients,  the 
partial  correlations,  the  predicted  values  and  residuals,  and  the  sunmary.  Plots 
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Figure  4 

BMDP2R  Variable  Identity 


A  Speed  Rating 

B  Qual ity  Rating 

C  Job  Curiosity 

D  Persistence 

E  Professional  Identification 

F  Organizationa  Identification 

G  Self  Starter  Tract 

H  Work  Shift 

I  Enlist  Year 

J  Skill  Level 

K  Current  Duty  Assignment  Yean 

L  Current  Equipment  Assignment  Year 

M  Months  in  Current  Assignment 

N  Sex 

0  Equipment  Type 

P  Rank 

Q  Hours/Shift 

R  Days  Between  Breaks 

S  No.  Additional  Duties 

T  Hours  Additional  Duties 

U  No.  Clubs 

V  No.  Persons  Supervised 

W  Months  Supervision 

X  Weight  Handled 

Y  Clearance  for  Service 


AA  Clearance  for  Remove/Replace 

BB  No  Internal  Components 

CC  Hours  Between  Equipment  Servicing 

DD  Quality  Technical  Information 

EE  Quality  Test  Equipment 

FF  Technician  Knowledge 

GG  Technician  Skill 

HH  Satisfaction  Ind.  Motives 

II  Homogeneity  of  Attitude 

JJ  Sat.  Interpersonal  Relationships 

KK  Satisfaction  with  Supervision 

LL  Structure 

MM  Rewards 

NN  Risk 

00  Warmth 

PP  Conflict 

QQ  Identity 

RR  Locality 

SS  Sat.  Pay  and  Benefits 

TT  Social  Status 

UU  Fatigue  Trait 

VV  Ascendency 

WW  Responsibility 

XX  Emotional  Stability 

YY  Sociability 
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requested  include  the  normal  probability  plot  of  residuals  and  a  detrended 
(trend  removed)  normal  probability  plot  of  residuals. 

The  BMDP2R  computer  program  computes  estimates  of  the  parameters  of  a 
multiple  linear  regression  equation  in  a  stepwise  manner.  Variables  are  entered 
(forward  stepping)  or  removed  (backward  stepping)  one  at  a  time  according  to  any 
of  four  possible  criteria.  As  may  be  noted  in  the  BMDP2R  sample  output  in 
Appendix  E,  control  limits  on  the  stepwise  procedure  are  established  by  speci¬ 
fying  F-levels  to  Enter  and  Remove  and  a  Tolerance  based  on  whether  an  entry 
or  removal  of  a  variable  will  produce  an  R*  (accountability  level)  change, 
when  compared  to  previously  entered  independent  variables,  exceeding  the 
tolerance.  The  first  numbers  in  ENTER  and  REMOVE  establish  entry  limits  and  the 
second  numbers  in  ENTER  and  REMOVE  are  used  as  remove  limits.  The  particular 
numbers  selected  for  use  have  been  found  to  work  well  in  providing  qood  predictor 
variables  with  a  very  low  level  of  multicollinearity;  i.e.,  a  high  level  of 
confidence  can  be  placed  on  the  variables  selected  for  the  prediction  equation 
at  the  termination  of  the  stepwise  procedure. 

At  each  step  in  the  stepwise  regression,  an  ANOVA  is  developed  and  the 
following  parameters  are  printed:  F  ratio,  R  (multiple  correlation  coefficient), 

R2  (which  in  percent  form  accounts  for  the  variation  in  the  dependent  variable  which 
can  be  accounted  for  by  the  independent  variables  included  at  the  step),  and  the 
Standard  Error  of  the  Estimate.  In  general,  R2  values  of  0.70  and  better  are 
considered  very  good  in  subjective  research  [70  percent  accountability]. 


Results  of  the  Study 


Williams  Air  Force  Base.  For  the  Field  Maintenance  Squadron,  data  was 
collected  from  18  supervisors  and  for  89  technicians.  Sixty-three  of  the 
technicians  worked  day  shift,  26  worked  swing  shift,  none  were  mid-shift.  Seven 
of  the  technician  respondees  were  female,  18  of  the  technician  respondees  were 
civilians,  25  of  the  technician  respondees  supervised  others  in  some  capacity. 

Four  of  the  technicians  evaluated  by  their  supervisors  were  "no  shows"  for  the 
technician  survey.  The  computer  output  from  the  FORTRAN  data  processing  program 
is  provided  in  Appendix  E. 

FMS  Statistical  Results.  As  described  earlier,  three  statistical  computer 
runs  were  made  from  the  data  for  each  squadron,  using  the  BMDP2R  stepwise  linear 
multiple  regression  model.  The  selection  of  dependent  variable  was  varied. 

Table  7  shows  the  FMS  data  after  processing  for  statistical  distribution 
properties.  It  may  be  noted  that  the  mean  speed  of  performance  rating  by 
supervisors,  across  the  squadron,  is  6.5467  with  a  standard  deviation  of  2.1008. 
Likewise  the  mean  quality  of  performance  rating,  across  the  squadron,  is  7.3067 
with  a  standard  deviation  of  2.0466.  Letter  names  were  applied  to  the  variables 
as  shown  earlier  in  Figure  4.  Coefficients  of  variation  were  high  for  M  (months 
in  current  assignment),  S  (number  of  additional  duties),  T  (hours  on  additional 
duties),  LL  (number  of  service  clubs),  V  (number  of  persons  supervised),  W 
(months  in  supervision),  VV  (ascendency  trait),  WW  (responsibility  trait). 

Using  the  stopping  criteria  discussed  earlier,  the  stepwise  forward  and  backward 
regression  included  26  steps  when  A  (performance  speed  rating)  was  used  as  the 
dependent  variable  and  resulted  in  the  summary  table  shown  in  Table  8.  The 
final  model  included  10  significant  predictor  variables,  including  the  performance 
quality  rating.  The  resulting  prediction  equation  is 


31 


Table 


JXQ0N®NIN®J1TN®-Nmr  O^NN— iTINNflQO  —  ®  -*0  J'N'H  IN®  o_  r-  > 

:  ^<ao  n/'»NOMVvP^on(N®  x  —  —  x  n  —  a  *©  •«  —  n  ®  x  ooooo  — ui  «•* •«.<<(.»  *”i -^<j  X  a 
)T-Q«  NN  —  ®  •  flifl<NO®  0-NN®N«  T-CO'OU^  —  O-CXaNi/U/liil^  TO*  NNOlflOONO  — 1/1 
H^QO  x  —  —  Ui  *•“*  vnoi'O  vn«  —  Nn-o®  o®  o  —  NX*  o  ^  n  —  xa  a  nn  n  —  — « cf»  —  Jt  >«x  ji«  x  v/ir-i  a  n 

i  (  (  (  . 

— —  —  —  —  —  —  TN  — N-NNrr<flN«N-------  —  —  —  —  —  —  —  —  rvrvfsi  —  <s* 


H-W  0«®0>^OX®  —  ®  0-N^NaN^Njl  4(/)  Q<*  >■  X  «*»  -ONk flJlTNT®  04  O-T  OKO^MS^r  X  J1 

-ACE  D-O  J1  />■«•«>  3JI>  --«>  -•  I  -O  -  ^  rs  »)  >  3  r-»  ®  n  x  -O  05  -O  3  NN  •->  -O  r  G  >\  "«3  -n  .0 

UiO  X  «  O  X  NX-  —  —  <"l  —  X  mU1(N<0®  (NNrvQ4«)ipn>®»  or  4«‘ONi^T4>|NKNN»r-«^S4  N  3 
.JsJ  >C  3Q  n  >  N  -O  -O  TN.*»®T  4C?N  3«4<j>  — -n  t  JIN  <*KN  r  ''I '•I'HH  ^NNN^xrt  O  ^ 

Jlfl  . . . . 

<  l  n^NN  I  Nn-Tfl  |  I  |  |  I  —  —  —  —  — 1*>  «  flONN  N  NN  N  NNN  N  —  —  —  N  NN  N  — 

XO  I  I  I  I  I  I  I  till  I  I  I  I  I  I  I  t  I  I  I  I  I  I  I  I  »  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I 

s»~ 


*-  Q0Qa2QQCQCQQC3aa00a003003O3GOa0COC0QQ  QQQQQ3GOCCC  3  3 
•/lUi  300  3  3030  03  33000C3  3300  33C333w30  0033  300000C300CC33  33 
«*J3  03333330303333303333333033303030300  33  O  30  Q  0  30  3  3  30  3  3 

33 ooooooooooooooooooooooooooooocooooo  0000a  ooooooooco 

. . . . . . .  •  . . .  »  • 

O  009*  X  XX  r  N>N>>ONi,nB(NMn«irt->OT  JlOOiflifl  N  —  <•)  NJ1N  ifl  —  m9>«  <N  » 

3  —  —  ■**  n  -*  a>  —  —  >x  ji  3 


—  30333330003330033303  3  3033033033333330330003033  33  3  O 

Jluj  33303333333033333303033333330303333303  33  0033033333 
*i3  30333333303333333300033333333330330330333333333333 
-i-j  3  33  cccooocococooooaoooaoooooooooococoo  03  3  3CCO  3  30  O  3 


/I  X  3"*  r>1>r  Jl-lJJ-.Jl.Nrj>><13J>*IJl--C8  1-0  3fl5r.5N>Njn^.-M\N^\3  S\  3 

«  TT4®  '0<**TakflCN^O«NnT#(NN*(nj>N>Nn^N0r  TSJ1  3  0®  T  N—  T  J1  G<^  4  j" - -  ,\  r 

•/IN  —  3  —  r?N3  -C  3-v  -O  UN  -OJI  J1  _n  -N  3  r  >  — N  -TN-N4  J1  3  2>',IJ|N3  -10  N  3 

3  >  —  >  -*  >  iaj-.a.i-oojir  a  tn-i  j  ->  r  r  J  —  -o  J  o  j  o  3  10  -nr  —  r  „*>  •>  -i  r  -i  o.n  a  c 

X  <“1  «*>  N  —  N  —  —  —  5><17  J13^N-  X  X  ^X  •0X<~>NNNN— i-l  —  X-nXlT  T  T  X  XX  X  7-  ~  -  TN  \r, 


yioixGM-G-T^C'O-r  4 nu"i  nno*«-i/»no-<*h,  ao  ~ n  n-o^t  r  -.-<*it,t1/in  -hm?  —  —  —  -s. 

i/l>-GC>J>3>T'fli*ia5',ia«>3'«0‘NNCC  O®  NtNNTJ'  3  —  X  <**  Jl  **un  n®  JI-oO1  OT"i  •/  -c 

u.  x  c-o  r  jiNN-CN'noa-fl'^Gx  3*  -srtrtNNiy  ji/.n-s  D/— .'n  n—  3  > 

2N-.n  r  -0  *r>  o  on  —  on  n  3  nui  x  n  n  3  N  3  -o  ji  n  ir.  jn.ni.is  <o  or  4.  o  -5  n  —  x  — —  j*  - 


1  I  I  I  I  M—  —  NN  N1<*IN  —  —  NTN1 
III!  I  II 


I  I  I  I  I  I  I  I  I  I  I  I 


33  >  —  <*l  3«*X  —  —  ON  —  -$Nn  JN  jlf  3J1  3TN>/,3  ->n  n  -CN  XN>  —  C— n-C  —  .1 

ui—  oon  n  x  x  m-04N750a  —  >«j*.  — '■asn  oji  x  x  —  rff-z-nanni  -  —a*  —  rv 
— —  nx  *»n  -n  ji  >  .n  J'/iNi  j>®n-o  r  3«T.is>3oniT>a  a  on  x  on—  n  nn  n-3unngjg< 
nn'nfl<*iNrr.,n**<nnx  n  x  onxnxjwio  x>  n  o  n  n  rx  x  x  x  x  x  t  x  x  05;  x  >  3  n  **■ 


X  -C  3  X  3>>  "1N3.'  3  X  X  N  >  X  x  X  •■*)  X  O  O  —  ill.1  X  3  NX  -*1  IT  JUrn;>  j 

32  G<G-N>3N*ir>N3,lr2>Nn3c--Nn3ji  xr-ixr3N  cxoOx.n  —  ;;3s?. 
23  3X0  0  <**.  3  X  w'l  N  tAX  JIN  ®  — N  .*»  x  —  X  N  ■-«  .N«r  T  3x  —  >  x  3  *1  X  N  <*•  —  n  -C  J*.X  3  3X3  —  3 
<  —  -  33  3332?  •1G>3T'.5N4*!>?33J4>«n  3  OX  o  >  i  «  n  n  G  N  r  x  -A  3  X  >  „*  * 

OK  . . . . . . . . 

Z*NN—  —  —  —  —  .N-—  N—  NX—  —  n  Jl  —  -•  —  >  3X  33  >  >>  >  3  —  Jl  N -C 

<—  —  nn—  — /r  —  c  —  —  —  —  — 

*-  ->  — 
t/iui 


N.N  3  IrnOOSOOINT  3*s.  3>,  13s-  -l  N  -J-v  Isis  NN  N-JI-IN-ONrG 

:o:*i2‘iJ3332icno.fl  i-c-’io-no-ciocnoc-n-nc-^.  o-^.  *--033 

2X33JIX  —  -C®«-C«NN— XXJIN  —  a  —  «  3  ^  X  «ON  3  n^i/'XN  3N  X  NX  X  —  —  u“l  <  nN^S-3 

<.1- J5  3SsN  J.iN.ia  ox  >  ®  «  o  x  o  3  ■*!  —  x  x  •>  3  -o  a  -i  x  r  >  —  >  >  x—  .nrac*.  n  3  c  c 

*1  •»•••'  . . . . . . .  . . . 

r  -on  -n  n.^nn  —  nx  •>  ji*  —  —  xn  x  —  jnNon-n-r3-NinNCf*.iy:  1--- 

<  <  <  ^  PsrvNfNNNNfN-SN - -  -  I 


—  t:  jo  j*  *  - 


»  •  —  •N'nx^l^N*>  3-N<1?Jl«N  8  >  3  —  N  ^  X  a>  a-.N'-IX  /*<M)>3-Nnf  Jl^sJ  X  3  — 

3  —  —  —  —  ———  —  —  —  nnnnnnnn  NN'i'nin'i r  rxr  r  r  rrr  />  Ji 

s 


Table 


v/) 


3 

H* 

X 

2  3 

3 

-U  UJ 

•M 

cc 

— 

Z3 

o 

loo 
CL  O 

UJ 

L.Z 

— 

c  — 

OJ 

z 

3 

—  ft 

u 

— 

c 

U.-J 

2 

Ojs 

« 

00 


<D 

Q_  (V 

-C  ,0 

■*->  ft3 

•i—  'p* 

5  S_ 
oj 
C  2> 
O 

i-  4-> 

“O  C 
03  <L» 
3  XJ 

cr  c 
lt)  a> 
a. 
s:  o> 

Lt_  Q 

*  q; 
CO  -C 
U.  4-J 
< 

Ift 

<✓>  03 

03  <£ 

r—  0> 

*—  c 


<0 
s-  cc 
o 

<*-  “O 
01 

>»  <u, 

u  aj 
03  on 


g 

3 

on 

a: 

CM 

Q_ 

§ 

CO 


3 


2 

3 

3 


•  fU'ftTft-0'**.a>30  3  —  N  ft  Crv  -©ft  T  — 2 


X- 

-J  x. 

X)< 


I  > 

CO 


-«*ft  ft  •©>  o 
— T  O'  <-»«  »■  ft 
<T3N<nN'fl 
^y  -o 

—  — N  i\  — 


lorfl-j-ji—nN. 

tnnts r - 

- SJ3 

t  z  ->  •* 


t-N>OJl  NO 
*'>3  y  N  ^  ft 

>  3  \  V—  <J  2“* 

>  s  .  s-,i:- 


J13T  *>n-"-*NN  — -— — -J  — — - 


-l  -cji^ijirr  r\>ji^to-3<m-o.iN3 

yi3>-ooT^^iiNi33-3<  ©ft^ftft?ft<N  —  -ftftaj-vft 
<yir*l-.— .3C333C  333C33330O33J03 
.Z43C0Q300333 33  2  3  33  30  3033303 
X 

03  t  I  I  I  I  I  «  I 

2  — 

•a  Z  -G  —ft  XNN3r«  Nfx  N^>3t?3»^  — >0X3 
>  Oft  3'IO'O'V^OCV'l  rjis  N 

rss'sflr  rjHNNNBo^ac-  —  —  —  3  o  s  2 
3*00»r^rvrsr<*fxrv«»f»,^,^,pH««l.xi3Xe«3X^f>*"s 

Uj  ft  •  ••••••••••••••••••••••••• 

JZ 

o  2 2  oy  •*.  r>  >*v  c  s*n  >  n  3>  —  — 3  e -*«■  3> -c 
r  -c  a  o  r  c  2 ^  o  %  c c  n r  %%  >  civv  r 
-T  C'NTTJ‘<<<>*'‘*^XX*>>»CCCC>>>XS 

xaxx9raa3xs3xaxax>>>>xaass 


jj-  a *-  i  » 

ft  <*i  -ft  r<*  3^  n 
x  N  .ft  ><  * 


►-  *2  ft  u.  *X  2  o^t  ►  1 


3  l  •«  r  ft  ■©  **^ 
r  *;  3 
3  —  ? 
ft  ft 


?  —  *v-ft  r  ft  ■©  >.  t  *  n  —  m  -  r  ft  o 

-  —  —  —  —  —  —  —  M*N  NNNNN 


33 


** 


A  =  -0.669  +  0.6088  +  0.358F  +  1.107H  -  1.151N  +  0.148P  +  0.382S  +  0.025X 


-  0.790Y  +  0.003CC  +  0.253EE  [78%  prediction] 


The  multiple-  R  for  the  above  equation  is  0.8848  and  78  percent  of  the 
variation  in  A  is  accounted  for. 

Table  9  shows  similar  results  when  B  (performance  quality  rating)  is  the 
dependent  variable.  The  final  model  included  only  5  significant  variables 
after  processing  through  22  steps.  The  resulting  prediction  equation  is 


B  =  0.768  +  0.566A  +  0.780C  -  0 .01 OL  +  0.279R  -  0.109V  [76%  prediction  ] 


The  multiple  R  forthe  above  equation  is  0.8722  and  76  percent  of  the  variation 
in  B  is  accounted  for. 

Table  10  shows  similar  results  when  the  transformed  dependent  variable 
ZZ  =  0.4A  +  0.6B  is  used  and  A  and  B  are  deleted.  After  29  steps,  only  3 
predictor  variables  remain  and  the  resulting  equation  is 


ZZ  =  1.599  +  1.300E  +  0.219P  +  0.009X  [65%  prediction] 


The  multiple  R  for  the  above  equation  is  0.8077  and  65  percent  of  the  variation 
in  ZZ  is  accounted  for.  Of  course,  if  we  accept  a  larger  tolerance  relative 
to  the  partial  correlations,  and  more  predictor  variables,  more  of  the  variation 
in  ZZ  can  be  accounted  for.  For  example,  after  18  steps,  there  are  14  pre¬ 
dictor  variables  which  account  for  78  percent  of  the  variation  in  ZZ.  At  that 
point  the  equation  is 


ZZ  =  1.856  +  0.936E  +  0.336G  -  0.418H  +  0.139J  -  0.012L  +  0.187P  +  0 .2145 

-  0.340U  +  0.017X  -  0.340AA  +  0.377GG  +  0.056II  -  0.039PP 

-  0.020SS  [78%  prediction] 


It  may  be  noted  from  the  above  that  11  more  predictor  variables  (and  the 
questionnaire  data  to  support  them)  are  needed  to  provide  a  12  percent  improve¬ 
ment  in  accountability.  Further,  multicoll inearity  may  be  present. 

Although  not  included  in  this  report,  the  prediction  and  residues  tables 
in  the  computer  reports  show  that  when  A  is  used  as  the  dependent  variable,  only 
one  time  in  75  predictions  evaluated  did  the  number  of  standard  deviations 
between  actual  and  predicted  exceed  3  and  in  only  one  other  trial  did  it  exceed 
2.  Thus  the  prediction  capability  is  quite  good.  When  B  is  used  as  the 
dependent  variable,  in  75  predictions  the  standard  deviation  between  actual 
and  predicted  exceeded  3  once  and  exceeded  2  on  three  other  trials.  With  ZZ 
as  the  dependent  variable,  in  75  trials  the  standard  deviation  between  actual 
and  predicted  exceeded  3  once  and  2  in  four  other  trials. 
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8MDP2R  Summary  for  Williams  AFB,  FM  Squadron  with  Performance 
Qua  1 i ty  Rating  B  as  the  Dependent  Variable 
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QMS  Resul ts .  For  the  Organizational  Maintenance  Squadron  at  Williams 
AFB,  data  was  collected  from  18  supervisors  and  for  70  technicians.  Thirty-two 
of  the  technicians  worked  day  shift,  27  worked  swing  shift,  and  11  worked  mid- 
shift;  40  of  the  technician  respondees  were  female.  All  were  military.  Twenty 
of  the  technician  respondees  supervised  others  in  some  capacity.  Four  of  the 
technicians  evaluated  by  their  supervisors  were  "no-shows"  for  the  technician 
survey.  The  computer  output  from  the  FORTRAN  data  processing  program  is 
provided  in  Appendix  F. 

QMS  Statistical  Results.  Table  11  shows  the  BMDP2R  data  after  processing 
for  statistical  distribution  properties.  It  may  be  noted  that  the  mean  speed  of 
performance  rating,  across  the  squadron,  is  6.7714  with  a  standard  deviation  of 
1.8971.  This  may  be  compared  with  parallel  figures  of  6.5467  and  2.1008  for  the 
FMS.  For  quality  of  performance  for  OMS  the  values  were  7.3143  (mean)  and  1.8537 
(standard  deviation).  Comparable  figures  for  the  FMS  were  7.3067  and  2.0466. 
Coefficients  of  variation  were  high  for  some  of  the  same  variables  as  for  FMS. 
When  A  was  used  as  the  dependent  variable,  the  stepwise  regression  involved 
30  steps  and  resulted  in  8  significant  predictor  variables.  The  resulting 
prediction  equation  is 


A  =  -1.846  +  0.547B  +  0.388F  +  0.256Q  -  0.345R  -  0.389LL  +  0.784FF 
+  0.112LL  -  0.089QQ  [72%  prediction] 


The  multiple  R  for  the  above  equation  is  0.8479  and  72  percent  of  the  variation 
in  A  is  accounted  for.  The  sutmiary  is  provided  in  Table  12. 

Table  13  shows  similar  results  when  B  is  the  dependent  variable.  The  final 
model  includes  15  predictor  variables  after  29  steps.  The  resulting  equation 
is 


B  =  0.811  +  0.283A  +  0.6550  +  0.747F  -  0.468G  +  0.569J  -  1.266N 
+  0.5190  -  0.137P  -  0.371R  -  0.007X  +  0.278EE  +  0.422GG 
-  0.081PP  +  0.132UU  +  0.152XX  [81%  prediction] 


The  multiple  R  for  the  above  equation  is  0.8983  and  81  percent  of  the  variation 
in  B  is  accounted  for. 

Table  14  shows  results  when  the  transformed  dependent  variable  11  =  0.4A  +  0.6B 
is  utilized.  Stopping  after  27  steps  the  multiple  regression  model  gives  11 
predictor  .ariables  and  results  in  the  following  equation: 


11  =  1.142  +  0.3640  +  0.727F  +  0.815J  -  1 .680N  -  0.405R  -  0.282AA 

+  0.268EE  +  0.723GG  -  0.048II  -  0.047PP  +  0.133X  [78%  prediction] 


The  multiple  R  for  the  above  equation  is  0.8846  and  78  percent  of  the  variation 
in  11  is  accounted  for. 
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Computer  program  prediction  tables  show  that  when  A  is  used  as  the 
dependent  variable,  no  trials  err  by  3  or  more  standard  deviations,  three 
trials  err  by  2  standard  deviations.  With  B  as  the  dependent  variable,  the 
same  results  are  obtained.  With  ZZ  as  the  dependent  variable,  in  only  two 
cases  do  the  prediction  errors  approach  two  standard  deviations. 


Williams  AFB  Overall  Results.  The  goal  of  this  research  study  is  to  provide 
a  measurement  instrument  which  will  model  performance  effectiveness  within  an 
Air  Force  squadron.  Performance  is  a  combination  of  rate  of  work  and  accuracy 
of  work.  For  the  peacetime  Air  Force,  the  weightings  of  40%  on  speed  and  60% 
on  quality  seem  reasonable.  Therefore,  the  model  which  predicts  11  (0.4A  +  0.6B) 
seems  most  useful . 

Similarities  and  differences  may  be  observed  for  the  11  prediction  models 
for  the  FMS  vs.  OMS  at  a  78%  level  of  accountability: 


FMS:  11  =  1.856  +  0.936E  +  0.336G  -  0.418H  +  0.139J  -  0.012L  +  0.187P 
+  0.214S  -  0. 34011  +  0.017X  -  0.340AA  +  0.377GG  +  0.056II 
-  0.039PP  -  0.020SS  [78%  prediction] 


OMS:  11  =  1.142  +  0.3640  +  0.727F  +  0.815J  -  1 .680N  -  0.405R  -  0.282AA 

0.268EE  +  0.723GG  +  0.0481 1  -  0.047PP  +  0.133XX  [78%  prediction] 


Variables  J,  AA,  GG,  II  and  PP  are  common  between  FMS  and  OMS.  However,  several 
factors  which  surfaced  as  significant  for  FMS  are  different  from  those  which 
surfaced  for  OMS.  Table  15  lists  the  factors  which  are  involved  for  each 
squadron . 

It  is  also  of  interest  to  note  what  factors  for  OMS  would  provide  approximately 
a  65  percent  prediction  level  {Multiple  R2),  similar  to  the  3  factor  FMS  model. 

This  reduced  equation,  obtained  at  step  5  for  the  OMS  data,  provides  the  prediction 
equation 


11  =  -0.187  +  0.907F  +  0.864J  -  0.466R  +  0.215EE  +  0.633GG  [67%  prediction] 


For  the  equation,  the  multiple  R  is  0.8163  and  67  percent  of  the  variation  in 
ZZ  is  accounted  for.  However,  the  Beta  coefficients  may  be  weak. 

The  results  in  Table  15,  based  on  R2  comparisons  at  approximately  78  percent 
accountability,  show  the  significant  Beta  coefficients  for  the  prediction  equations, 
the  mean  values  of  the  variables  from  the  data  collection,  predicted  values  for 
ZZ  from  the  equations  and  the  actual  mean  value  of  ZZ  based  on  supervisor 
evaluations  across  each  squadron. 
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BMDP2R  Summary  for  Williams  AFB ,  OM  Squadron  with  Transformed 
Variable  ZZ  =  0.4A  +  0.6B  as  the  Dependent  Variable 
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Table  15 


Comparison  of  Multiple  Regression  Equations  for  Williams  AFB, 
Organizational  Maintenance  and  Field  Maintenance  Squadrons 
(Compared  at  R2  Level  of  Approximately  78%, 

Dependent  Variable  is  ZZ) 


FMS 

i  QMS 

Factor 

Beta 

Coeff. 

Mean 

Contr. 

Beta 

Coeff. 

Mean 

Contr. 

1 . 

D  - 

Persi stence 

+0 . 364 

3.114 

1  .134 

*2. 

E  - 

Prof.  Identification 

+0.936 

3.040 

2.845 

3. 

F  - 

Organ.  Identification 

i 

+0.727 

3.043 

2.212 

4. 

G  - 

Self  Starter  Trait 

+0.336 

2.760 

0.927 

5. 

H  - 

Work  Shift  (performance 
lower  in  swing  and  mid 
shifts) 

-0.418 

1.280 

i 

-0.535 

6. 

J  - 

Skill  Level 

+0.139 

4.560 

0.634 

+0.815 

4.857 

3.959 

7. 

L  - 

Current  Equipment 
Assignment  Year 

-0.012 

65.573 

-0.787 

8. 

N  - 

Sex  (performance 
lower  for  male) 

-1 .680 

0.943 

-1  .584 

*9. 

P  - 

Rank 

+0.187 

4.947 

0.925 

10. 

R  - 

Days  Between  Breaks 
(performance  lower  with 
longer  work  weeks) 

-.405 

5.057 

-2.048 

11. 

S  - 

No.  of  Additional  Duties 

+0.214 

0.613 

0.131 

12. 

U  - 

No.  of  Clubs 

-0 . 340 

0.613 

-0.208 

•13. 

X  - 

Weight  Handled 

+0.017 

39.133 

0.665 

14. 

AA 

-  Clearance  for 
Remove/Replace  of 
Components 

!  -0.340 

2.467 

-0.839 

-0.282 

2.929 

-0.826 

15. 

EE 

-  Quality  of  Test  Equip. 

+0.268 

1  .143 

0.306 

16. 

GG 

-  Technician  Skill 

+0.377 

3.467 

1.307 

0.723 

3.857 

2.789 

17. 

II 

-  Homogeneity  of  Group 

Atti tude 

+0.056 

23.947 

1.341 

+0.048 

26.971 

1  .295 

18. 

PP 

-  Organizational  Conflict 

-0.039 

22.547 

-0.879 

-0.047 

22.200 

-1  .043 

19. 

SS 

-  Satisfaction  with  Pay 
and  Benefits 

-0.020 

18.843 

-0.377 

20. 

XX 

-  Emotional  Stability 

+0.133 

-1 .786 

-0.238 

ZZ  Intercept 

1  .856 

1  .142 

Predicted  Mean  Performance  Level  ZZ  for  Squadron 

7.006 

7.098 

Actual  Mean  Performance  Level  11  for  Squadron  7.003  7.097 

(8ased  on  Supervisor  Evaluations) 


•Present  in  FMS  final  3  factor  model. 
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Luke  Air  Force  Base.  For  the  Component  Repair  Squadron,  data  was  collected 
from  12  supervisors  and  for  58  technicians.  Thirty  of  the  technicians  worked 
day  shift  and  28  worked  swing  shift,  8  of  the  technician  respondees  were  female, 
3  of  the  respondees  were  civilians,  17  of  the  technician  respondees  supervised 
others  in  some  capacity.  Five  of  the  technicians  evaluated  by  their  supervisors 
were  "no-shows"  for  the  technician  survey.  The  computer  output  from  the  FORTRAN 
data  processing  program  is  provided  in  Appendix  G. 


CRS  Statistical  Results.  Table  16  shows  the  CRS  data  after  processing  by 
the  BMDP  package  for  statistical  distributions  properties.  The  mean  speed  of 
performance  rating  by  supervisors,  across  the  squadron,  is  7.0508  with  a  standard 
deviation  of  2.4735.  The  mean  quality  of  performance  rating  is  7.8136  with  a 
mean  of  2.3229.  High  coefficients  of  variation  are  noted  for  LL  (number  of 
clubs),  W  (months  of  supervision)  and  WW  (responsibility  trait).  Using  the  same 
stepwise  stopping  criteria  as  for  the  Williams  AFB  data,  the  stepwise  regression 
included  13  steps  when  variable  A  (performance  speed  rating)  was  used  as  the 
dependent  variable,  resulting  in  the  summary  table  shown  in  Table  17.  The  final 
most  efficient  model  includes  only  3  predictor  variables  and  results  in  the 
following  prediction  equation: 


A  =  -0.442  +  0.481 B  +  0.201V  +  1.002GG  [70%  accountability] 


Multiple  R  for  the  above  equation  is  0.8338  and  70  percent  of  the  variation  in 
A  is  accounted  for. 

A  maximum  R  of  .8691,  with  76  percent  explanation,  is  obtained  with  an  8 
factor  model  after  8  steps. 


A  =  -1.104  +  0.269B  +  0.510F  -  0.337U  +  0.138V  +  0.249AA 
-  0.004CC  +  1.145GG  -  0.131XX  [76%  accountability] 


Table  18  shows  similar  results  when  B  (quality  performance  rating)  is  used 
as  the  dependent  variable.  The  efficient  model  includes  7  variables  after  31 
steps,  resulting  in  the  equation 


B  =  1.014  +  0.266A  +  0.623C  +  0.590D  -  0.039K  -  0.960N  +  3.6550 
+  0.35900  [77%  accountability] 


The  multiple  R  for  the  above  equation  is  0.8747  and  77  percent  of  the  variation 
in  8  is  accounted  for. 

Table  19  shows  the  results  when  the  transformed  variable  11  =  0.4A  +  0.6B 
is  used  as  the  dependent  variable  and  A  and  B  are  deleted.  The  model  stops 
iteration  only  after  42  steps  and  includes  18  variables  as  indicated  in  the 
summary.  The  prediction  model  is 
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BMDP2R  Summary  for  Luke  AFB,  405^  CR  Squadron  with  Performance 
Quality  Rating  B  as  the  Dependent  Variable 
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Table  19 

BMDP2R  Summary  for  Luke  AFB,  405th  CR  Squadron  with  Transformed 
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ZZ  =  2.369  +  0.805C  -  0.0881  -  0.031K  +  0.048M  +  1.382Q  -  0.631R 

+  0.209T  -  0.387U  -  0.136V  -  1.015Y  +  1.181AA  -  0 .011 CC  +  0.483EE 
*  -  0.41  OFF  +  0.754GG  +  0.069II  -  0.055RR  +  0.278WW  [92%  accountability] 


The  multiple  regression  R  for  the  above  equation  is  0.9566  and  92  percent  of 
the  variation  in  ZZ  is  accounted  for. 

Approximately  77  percent  of  the  variation  in  ZZ  can  be  accounted  for  by 
only  7  variables  and  the  resulting  prediction  equation 


ZZ  =  -0.481  +  0.748C  +  0.303D  +  0.298J  -  0.017L  +  0.446AA 
-  0.005CC  +  1 .095GG  [77%  accountability] 

At  the  92%  level  of  accountability  for  ZZ,  3  residuals  varied  by  2  standard 
deviations,  none  varied  by  as  much  as  3  standard  deviations. 


EMS  Results.  For  the  Electrical  Maintenance  Squadron,  data  was  collected 
from  11  supervisors  and  for  51  technicians.  39  of  the  technicians  worked  day 
shift  and  22  worked  swing  shift.  Four  of  the  technician  respondees  were  female, 
all  of  the  respondees  were  military,  18  of  the  technician  respondees  supervised 
others  in  some  capacity.  Three  of  the  technicians  evaluated  by  their 
supervisors  were  "no-shows"  for  the  technician  survey.  The  computer  output  from 
the  FORTRAN  data  processing  <*>'ogram  is  provided  in  Appendix  H. 


EMS  Statistical  Results.  The  mean  speed  of  performance  rating  by  super¬ 
visors,  across  the  squadron,  is  6.5769  with  a  standard  deviation  of  2.4443  as 
shown  in  Table  20.  For  the  quality  of  performance  ratings,  the  mean  is  7.4038 
with  a  standard  deviation  of  1.9328.  When  A  (speed  of  performance)  was  used  as 
the  dependent  variable,  the  BMDP  program  iterated  through  43  steps  and  produced 
the  following  prediction  equation  with  17  variables: 


A  =  -0.112  +  0.343B  +  0.475D  -  1.076H  +  17.0350  -  1.680Q 

-  1.001S  +  0.440T  -  0.009X  +  0.384AA  +  0.958DD 

-  0.310EE  -  0.895FF  +  1.101GG  -  0.252JJ  +  0.146NN 

-  0.284WW  -  0.316XX  [90%  accountability] 


The  multiple  regression  R  for  the  above  equation  is  0.9476  and  90  percent  of  the 
variation  in  A  is  accounted  for.  Table  21  shows  the  summary  results. 


At  an  accountability  level  of  approximately  77  percent,  the  resulting 
equation  contains  10  predictor  variables 
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Luke  AFB,  405in  EM  Squadron  Data  Showing  Statistical  Distribution  Properties 


n  9-  —  nx  —TO  N  n®  9>  0*/»  r**®  f*  O®  NN  J\  A  -N 

►-•c  on  «ono-hn4n--Ni/iM«»*»‘0  —  gin  —  o*o  —  x  «  «  co  xx  xr**4  unAi/i  om  —4  —  0  on  js  —&• 
moor  n  x  orn«r«r4  o<x®  rs«x  4i 1>  -NMii«c««oo4«a9>NO  ®«n®  <►  oaix  mnn  n 

wyrnNQ-r--rNrrNTNn  — •  o**«a0444«»  ONm -flan^nnw  ji® 

»im  •«••••»••••••••••••••••••••••••••••••••••«•••••••• 

«o 


►-w®  n*  4X  c«4  —  o  — 4  rs*®4  ®  m  4  9»®  ji  nx  ®  nix  c<hn  -  — c*  j>  4  —  ax  in  n4Q«n  nonnnx— nx 
ins  oo-iiiTTN  — ®  x  jwi  nN  o«<n®  Jinn-N  gi4 rN» x a»  r**-o  x  30  a  a  —  — ji r*.  <m in x  in x x  os 
UJOX  n  <4®  ®  4  o  nr*  «no^^'nooiA4«  r*  —4  iAN04  r  iA«<o  oat  0  044  r9>Omn  Onixgi— N*  ■o-n 
jvj40  0>  o  —  043— n.^  x  n  x  4TA  ®r*  xtii  at  rNnno®>no^  x  cm  —  oo»  xx  —  a  —  ®  <**<n®  r*  ji 

jm  . . .  t  •»•••••«•••»•  * . .  •  •  • 

<  nmn-nnn  nn  nNN  1  wn  —  n  041  1  1  1  1  ———  —  —  —  1  o«xo4  fsn n  nnN  0404 nn n  Ninf^cgf*  — 
ZO  I  I  I  I  V  I  I  III  ||  Itlll  I  «  I  I  I  I  I  I  I  I  I  «  t  I  I  I  t  I  I  I  I  I  •  I  I  I 


>»  0000000  0000000000000000  00000  000  QO  oo  o  ooo  00000000000 
muiooooooo  ooo  00  00  00  00  00  000  0000000000  000000  oo  000000000 
uioaa  00000  ooo  ooo  00  ooo  00  ooo  ooo  a  0000  oo  000000  00000000  o  00 
®joo 00000  00000000  ooo  00  0000000000000  000000  00000000000 
«<  •••••••#••••♦••••♦•••••••••••••••••••••••••••••••• 

ooo  xx  xxx  N4>  n.  xx  x—  —  n»  ox  n®  nn«  oxmoomiflxxNQom  <n4i/i  nn  ji  nx  omx  j>  j>  ji 

— —  n  r*.r«.  <a  — —  —  —  o  u)o  nxnnnnnnnnnnxN 


*-  ao  00000  0000000000000  ooo  0000000000  ooo  ooo  ooooaooooao 
OO  0000  3  OO  3  00  00  3  OOO  oa  003  00000000  30  0  00  000  ooaaooooooo 
Ml  300  00  00  ooo  ooo  00a  00000000  0000000a  00  ooo  ooo  00000000000 

JJOOOOOOOOODOQOOO 00000000  ooo 00 ooo  00  000000  00  coo  o  00  ooo 


vrtxxf*4XN«nx— x  jini  n  JI  M  X  3«N  4-*®  n34N4*ix  X  TOM4  4  Jl>  N4®NN  4  — X  X  4  -1 
-xm^O-n®  roc*  ex  jin  —  —1/1  r*  r%.4  -on  x  -t»4»  4x^n»  x  —  4  x  n4  xn  —  xjixtMJis  — 4 
lA04d0X4J)  40  4  CD 04  4  04  4J1  -MIO  -1>AXS  ®  4  ®JiiTX  04  0  on4  4X  n  -IN  a  —  N.  >  X  ® 
0.-N.N4  4-iv>T^->nfl  ji  4®  n  n  Nn  >  nrs.  4®  ji  n  ji  — — x  a  —  xn>  >is  — -isr  4r»>\?a 

tt*4tr  (MMINNlC*  — 0  N.  4J1  0X0  n  OX  NIP*  OX  x  —  —  —  01(14  04— X  04  4«N4Ndi<4N<Ni/l®NnNN 


tnnx  — f*.  — «  o  onrv  <*a  ®  r*»  _  ji «  x 4  xj>«  OT^X4^»  J>4  n.  >  —  r*r*.  ji  nx  4  «r*  x  x  x«  *  n 
1/iJiX  x«xn4(X4c*®  — Jinxr*<N®jin  XN  onx>jis  x  — On.ni  — — ji  r*.x  ji  Nin  N«-.NNNnui- 
ui  —  x  x  oo  —4/i  on®  —4  n  4  ®  >  ®  4  4X  ox  ®  ®r*  04  ®  r*.— r*  jin.  ®  -o  —  ji  —  <n  — ji  -o  nr.  4  —  —  x  o  -c 
zx9>N.fN®o4  04  n  no®  ®  0®O9>n®nx4  Nnnj(«NNN  jia  ®  xn  >  —  ®  -  x  x  o  x  n  n. 


i  •  •  1  1  1  —  1  1 04  <n  mm  n  —  n 
1  1  1  1  t  1  1 


I  —  N4— •  — N«  IN  —IM—  — —N4  — r>4  —  N4  ■  I 

Itllllllllltltll 


zo  4  —  —a  a  —  n  —  m  o  ji— ®  4  ji  Lfto®N*o®nN*n  nr*.  —  m»  ji  ji  4  n  4  ji  ji  -nn  a  4  a  ®  nr*,  o  ji  nj*  — 
.4  —  —  —  j»a  x  m®  004  Ji®*  no—  -nodich  9*  40N.ji4xnN.— «  x®xo</)®mx®o  —  x  ox  —  xx  on 
-hn<90n<>  an  —  49*  on>  01 »»  43  jit/14®  — 4nj>nx  —  xn  n  — —  mmx  nxMMMx— j>4— x 
vj<  nNx4  xxx  nnn  nn  NX  m  4  M  n  — n  no  n*  4®MN*xJiOxMnnnnnnnnnnnnnnonM3 


n®  n*m  &  ji  x  4<n  n  nr*.  >n  —  ox— xa>^n®rN®rN<nx— — ji4Jio  —  jinn  <N4  <n  ji  ®  aact  ji- 
31  x.N4<so  r  ®  x  n—  x  ax  4  r>  s  —9*  .nji  >•*  —  o***  o4n  n  — >  m  ji  — *■*  njio*  NfiNJinniji 

80  xn  —  n  til®  r*»  nji  n  xin  r  4  4  iASN^ix  ®kA-*r4NS^9>  9*  <NJ1  viir**  ®  r*4®  <n<np«i  an  QjinA»NT4iN 
4-r»  f^n  C*4N4N4*/»^  X  04  4  MMN- «  JI®  O  <Nn  4(0  0  4N4n  0  O  — —  4  X4  —  — "*>  n  X  N4  4  0—9*  ^N. 


N4  —  X4n  —  N4  —  - 


N4Jli/»  —  —  Jia  — N4—  a  9*N.N.  fs.N.0  ®N.fN^a.  a />N|  —  N4—  - 


>  a  jrrjiMaji  «ji  n^  —  9*  —  n.  4n  oj»®  ®  nnn  o®4  a  aiaan  axx  n>*  ji  nj>n4s>ns 
4n  oji  /i*n  nn  a  o— N4  4n  4nn  x  4  o  —  4  nniNNOnx  o  ox  ——4  x  Ji4  44  —  4  4>  xn  4  x  n 
*n*>  o  O  —  —  ®krt  33na<i>rMMN0  4>kA4r  099»j)jinn«#  4®x  n— tN  ».n-9na®jin-/ 
4  JI  X  j9  4  An  Jir>  JI  9»n«  — ®  >®X®0ON4X®>  4  —  — N.  —  —  N  X®  X»*n  4  4J1  3«N  Jia^nojio® 


tAN(l(lNN(1-0XN4A 

4  44 


UN  x  n*  — 1*<  x  — N4  — n  nfwn  nn  r*N4X  <Nnn  xn4Ni  r«4®  x  4  —  — — 
<►  «MC  NN(^N  ONN  NNN  NtNN-  I  I 


<2  <®  w  OWU.  vj  X  —  ->0  JC2  01»3tmr*3>  »  •**- 

—  40  kJOuil*.a  z  —  *)4JC231»m»*3>«4»<aviaiiJ*jr"  T4  Jt231JXAN3>*<>. 


a  •  — nnx  ji 4n®>  3  — nn x ji 4n« > o  —  nn x ji4n. a >0  —  N»n x j»4-*.®x  o— Nnx/»4N®>a 
o  —  —  —  —  —  — — — — —  N4N4N4N#N#N»N4N4N*(i4n  n  nn  nnn  nnn  xxxxxxxxxxji 


50 


//si’  -  •  /  *t  v  •  1  1.617/  .nono  lo.nuno  -3.4/s*  i.sno* 


0 J 

u 

c 

<v 


C 

o 

4- 

L. 

<U 

Q- 


*r-  JD 

2  <0 


C\J 

<V 


-Q 

<T3 


c 

t. 

o 

<T3 

i- 

> 

*a 

fO 

4-> 

3 

c 

cr 

a> 

oo 

-a 

c 

a) 

UJ 

a. 

<D 

-C 

Q 

+-> 

LO 

a> 

O 

-C 

-M 

l/l 

CO 

fO 

u_ 

<c 

< 

0) 

cn 

J* 

c 

3 

-J 

•M 

i- 

os 

o 

“3 

<u 

>1 

<D 

s- 

Q. 

1 

OO 

3 

00 

OC 

CVJ 

a. 

Q 

ZO 

ujuj 

oo 

Z3 
WJ 
LW 
UiZ 
Q  — 

Z 

—4M«n  rui4r*>co»>  o— NcirnTi/KN*®'  o  —  nat  ji  t\A  oo>®* 

Ul  —  —  —  —  —  ——  —  —  —  —  —  fXPg  rx  Oj<N  fN(X<N(N(N(N<NrN<SfNiNfSfsr^— - 

U.  -J 
O  C0 
< 

Z  — 

UIZ 

®< 

x> 

3 


Ul 

o 


UI  *. 

o  o 


4  3®  — 1>  T  -n  -O 

o  —  sr  ^  ®  u>  4^ 

O^O*’  4» 

N  UliA 

•  ••••••• 

—  «nfuPM»*» 


I  oc  Or*  o  MMNNniiint/iN  — 

ow  a*a*o  zwnai  — 

»-*-  r  —  —  o®tsr**f»  — 

I  Z  mraN^ 

Ui  UJ  •  ••••••••••#•• 

>  — »  rv/n  rnr^-N  — nru^-CfN 

»o— 


-TOON^TOifla  o 

i/IN-N  — 

»*IMnONON«T9‘  fM 

o«rt«cr*or*oyz  >o<  — 


o  » 

t  a  «n<n 

O  iXI  ou» 

a  o  ut-* 


Ui  TT>  lT  <N»> 

i/io  Oina 

<  UI  TQNJIN 

uocr-ooa 

K  •  •  •  •  • 

uz 
z  — 


*■  o»  oonr  a'MNOrtmn^NN* &■> 

—  —  —  — —  py  fx  —  o  oao  oooooo  oo 
ooaooaoooaa  oaooooa  oao 


T"  <NCM  Psi  y  OJ)  O  UI  <1  —  M  — «  rv  rl 

<n  o*ao®  a^^o  — —  y«uwir 
0300030000030030 

ooo ooo ooo ooooooo 


•  »  I  I  I  I  I  I  I  I  ( 


I 


T  —  4  ®r*  00»^>'-14^»“44^''*l4r*4r'l0®rw«0®0®  —  —  <MN»®  -O  JIN  ON> 
0-4  DOTN-JXIl^JI  —  Mf*r*  r**.  ui  <1  »  4  —  ®  r*N-N  4JlJ»®NfMO>J1**  — 
y  y  —  **>  — NiNMNm^'nrr  y  <n n»N<N  — C>»- 

9yj1444r*r*r*r*.f*^.®«®®®®®w®«®^^».OD.^x».(>.>^y.»-o*»>o»ox>-® 
UJ  1/1  •••••••••••■•••»»••••••••••••••••••••••••«• 

a. 


-j  «<*i  3  til  *oo>r-»Jir  — >'1**  3ogr*«*fi  r  ii  f*—  x  »*  a  3»>**3.fl'*>  —  —  —  -u  4 
o  *'iD‘tit>«0  4ai'0  0o®<or*<',><A4®  <'*t/io<i4D‘  '*>4®  ooNNNfs*ooa>N^aMM'*‘ 
X  4*n«  —«n  r  til4»*  ®®  <<<4444( 

4r*»*  ®®  >>  >  o-o  y 

*••••••• . . . . . 


CO 


a 


z  J)  xt/i 

r  ZDZjz-ir-^ 


O  —  <1  iO  r —®f*f*f*'*t  r 
UI  —  *0  —  <N|  —  «■»  T  —  y  T 


X 

« 

>o 


X 

J  Ul  *  <Jui»> 

XXQ 

(AO  XI* 

X  < 

9-J 

X  ^DKOZWtfU^^lAKZZO 

j«  «sz  ji/no  ixi*  3 

•  « 

9J 

X 

<  z 

o 

—  »o^> 

ilDf  f 

*  4 

X 

r  <-voui  — 

—  ru  —  —  r-*  —  —  4r<n*s 

r  ru 

«*  -1 

► 

• 

z 

X 

< 

r 

Ul  ars  ®  3— fu<0  ^U>®  ^  ®D*  o  —  oi^r  \Jl  4N3»  3  —  N  "» 

X 

Xw3  - 

3 

3*-  Z 

3 

An 

OOMb  3*0992 


A  =  -0.563  +  0 .7518  +  0.750D  -  0.360E  -  1.128H  -  0.521S 


+  0.266T  -  0.192EE  +  0.711GG  -  0.379XX  -  0.245YY  [77%  accountability] 


Table  22  shows  the  results  when  B  (performance  quality)  is  used  as  the 
dependent  variable.  After37  iterations  the  resulting  model  contains  13 
variables,  with  the  prediction  equation  as 


B  =  0.646  +  0.188A  +  0.651E  +  2.376H  +  0.409P  +  Q.115T  -  0.121X 

-  0.288Y  -  0.012CC  +  1.290DD  +  0.213HH  -  0.081 II 

-  0.177JJ  -  0.269WW  [85%  accountability] 


The  equation  provides  a  multiple  R  of  0.9225  and  85  percent  of  the  variation  in 
B  is  accounted  for. 

At  an  accountability  level  of  approximately  77  percent,  11  variables  are 
present  in  the  prediction  equation.  Thus  the  inclusion  of  only  two  additional 
variables  in  this  case  increases  the  accountability  from  77  to  85  percent. 

Table  23  shows  the  results  when  the  transformed  variable  ZZ  =  0.4A  +  0.6B 
is  used  as  the  dependent  variable.  After  26  steps  in  the  multiple  regression 
program,  the  prediction  equation  contains  10  variables. 


11  *  1.173  +  0.939H  +  2.6820  +  0.383P  -  0.338R  -  0.825S  +  0.332T 
+  1 .101 GG  -  0.1 45 1 1  +  0.193UU  +  0.324VV  [70%  accountability] 


The  multiple  R  for  the  above  equation  is  0.8363  and  70  percent  of  the  variation 
in  11  is  accounted  for. 

To  expand  the  accountability  to  approximately  77  percent  requires  the  14 
variables  shown  below: 


11  =  0.944  +  0.933H  +  3.4010  +  0.324P  -  0.365R  -  0.705S  +  0.255T 
-  0.624U  +  0.106W  +  0.299AA  +  1.016GG  -  0.176II  +  0.070QQ 
+  0.114UU  +  0.267VV  [77%  accountability] 

Examination  of  the  predicted  values  and  residuals  shows  only  one  residual 
with  a  standard  deviation  of  2,  none  with  3. 


AGS  Results.  For  the  Aircraft  Generation  Squadron,  data  was  collected  from 
11  supervisors  and  for  41  technicians.  Twenty-three  of  the  technicians  worked 
day  shift  and  18  worked  swing  shift.  Five  of  the  technician  respondees  were 
female.  All  of  the  technicians  were  military.  Nine  of  the  techniciin  respondees 
supervised  others  in  some  capacity.  Three  of  the  technicians  evaluated  by  their 
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Table  22 


•  a  t/\  -ors  ®»  Q— <*vr  v/l  -0^®»-0— — Oa®^  -Ok/l  a  ^  P 
—  —  —  —  —  —  —  —  —  — —  —  —  —  —  —  —  - 


-■«»r  ji  on  ®co  30  > 

lilCn4  0</lN<ONNr<n 
»rQTNTKn^® TO 
—  ON  — <►  n'C'Q 

•  ••••••»•••• 

— -“04040*04— «->04<-l 


i  «o-*tn®  rva«Nin»naou*'no‘Oa  —  i/i  a  i/i  r-v  in  —  r-. 
O  *j  a-  0  04  03  —  o.^  -crv  —  «O®0»o.  Nm®-®  t  *  — o. 

►-  >-a  ar«4®'0in®.«a,n.or*rvO— a*  Ma  O  <  jlo*  !N 
•  Z0>»fla#  0^ooTJ10o^<««<-0N»»  -c  r  -o 

U.  UJ  •  •••  ••••••••••••••••  •  •  •  • 

©.  T-fl  a-  T-04—  —  <t  —0401  tHt*T  ^^«1(*4fN  —  —  —  — 


M4  a  ®«n  —a-  NrNOfl»nN®^®3o«'nfl<niM«-o<,i 

^»0  3— ji  o. -o  —  —  oa-oi ji  04^  —  *  a  pi®  a  ^inTrO-rr^oBN^NOT 

<  ina  '-Iv/l **»  <N  — — — 04Q  — — —  —  04  —  -<0000003000000  00-  — 

ui  «a  —0000000000  000  a  ooao  00000  00a  000  00000 


a  r*4i/>a  rv-«p<4in'^-<J'«o®®^®«xaarvo—^.'®oo(,»4*^o^in'^ina'n—»' 
O  —  ®  o«  a>  <n®  ®  —  «•>»/)  »  —  >  >  ji  o 

a  p-iNin®  o—  Main®®  a  —  «*)  irt>®  «  ®  >  oo-----oo>®nnj»t^^ 

ja  in<^'0^^‘f^r^^^f^^««»«®®®a-ff‘a‘>a»>a>o®®®«®®®® 

U4<n  . . . 

-j  x 

X. 

O  -®  N  -O  —  NN  ilfV-lLp  a  aJl9.J>-4-Jl!'irONJ»3'fl*Jl 

O  oina-  —  ®®in—  p^^afNofan  —  «NNO^ui«®K(i'>M>ifl- p^nr-.  —  p><n 

r  ®  in®  —  e»<nan<<r.*ao  —  ‘^'^'^aairwr^i/itrjiininaaa^a-o.iN  —  in 

*  f***-  ®®®«®®®«®a>^a*a.i>>a-o>x>o>»->(aaaoo>»'»‘> 


3  u. 

/X>0<J*.0  J*)3/l  1 

a  ®«n  <®  n  — *n  **  O— >  ^ 
a—  <n  a  *0—  —  .n  — n 


«  -J  -J  ■  ZM-3  WO  ">  U. 

n  «  NftiwwiKZiA-siwoo^riaMihO* 

t  <  z 

O  —  «®<^r  r43«>ri/iiii^^-»-«AN 

*  a  — Mifif  -*mr«4ni^r®»M  c*  —  <•>  — ^ 


tx 

t4l  3 
3»  2 
J\A 


1  «>  9«^mrjl4K  9®3  -N^a^l®N«>3-N^r  J14P 

----NN.NNNMNNNNi'l'')  i<®  <«»*•»  »**<*>  *• 


oibv  -.otet 


Table  23 

8MDP2R  Summary  for  Luke  AFB ,  405th  EM  Squadron  with  Transformed 
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supervisors  were  "no-shows"  for  the  maintenance  technician  survey.  The  computer 
output  from  the  FORTRAN  data  processing  program  is  in  Appendix  I. 


AGS  Statistical  Results.  Statistical  distributions  are  shown  in  Table  24. 
Table  25  shows  the  results  with  A  as  the  dependent  variable.  The  program 
stopped  after  48  steps  with  a  model  containing  40  of  the  49  possible  dependent 
variables.  Only  variables  F,  H,  K,  L,  M,  P,  AA,  BB  and  WW  did  not  enter  the 
prediction  equation,  the  equation  providing  a  perfect  (R  =  1.000)  prediction  of 
A. 


With  only  3  variables,  the  multiple  R  is  0.9003  and  81  percent  of  the 
variation  in  A  is  accounted  for.  This  equation  is 


A  =  -0.899  +  0.765B  +  2.6900  -  0.105W  [81  %  accountability] 

By  adding  variables  N,  S,  V,  XX  and  YY,  a  90  percent  accountability  for  A  is 
obtai ned. 


A  =  -0.113  +  0.703B  -  1.115N  +  3.4930  -  0.625S  +  0.755V 
-  0.1 88W  -  0.113XX  -  0.228YY  [90%  accountability] 


With  B  as  the  dependent  variable,  the  BMDP  program  iterates  through  43  steps 
and  produces  a  prediction  equation  containing  23  variables,  while  giving  an  R 
of  0.9970  and  a  99.4%  accountability  for  B  (Table  26). 

With  only  4  variables,  an  accountability  of  approximately  80%  is  obtained. 


B  =  1.785  +  0.851  A  +  0.515E  -  0.031L  +  0.104W  [80%  accountability] 


By  adding  variables  00,  SS,  V  and  J,  an  accountability  of  approximately 
90  percent  is  obtained. 


B  =  1.065  +  0.795A  +  0.708E  +  0.496J  -  0.069L  -  0.390V 
+  0.151W  +  0.16800  -  0.111SS  [90%  accountability] 


In  Table  27,  results  are  shown  when  transformed  variable  ZZ  =  0.4A  +  0.6B 
is  used  as  the  dependent  variable.  After  30  stepwise  iterations,  the  resulting 
prediction  equation  contains  12  predictor  variables: 


ZZ  =  -0.044  +  1 .4580  +  0.795D  -  1.294E  +  0.848J  -  1.520N 

-  0.535U  -  0.546AA  +  0.737DD  +  Q.440EE  +  0.17900 

-  0.321RR  +  0.105TT  [90%  accountability] 
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Table  24 

Luke  AFB,  405th  AG  Squadron  Data  Showing  Statistical  Distribution  Properties 
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Table  25 

BMDP2R  Sunniary  for  Luke  AFB,  405*-^  A6  Squadron  with  Performance 
Speed  Rating  A  as  the  Dependent  Variable 
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BMDP2R  Summary  for  Luke  AFB,  405i:n  AG  Squadron  with  Performance 
Qua 1 i ty  Rating  B  as  the  Dependent  Variable 
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Table  27 

BMDP2R  Summary  for  Luke  AFB ,  405th  AG  Squadron  with  Transformed 
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The  above  equation  gives  a  multiple  R  =  0.9481  and  90  percent  of  the  variation 
in  ZZ  is  accounted  for.  For  77  percent  accountability,  the  factors  of  E,  N, 

U,  AA,  EE  drop  out  but  H  is  added. 

An  examination  of  residuals  showed  no  cases  with  2  or  more  standard 
deviations . 


Luke  AFB  Overall  Results.  Table  28  provides  a  summary  comparison  for  the 
three  maintenance  squadrons  supporting  the  405^  Tactical  Wing  at  Luke  AFB. 
Comparisons  are  made  at  an  R2  level  of  approximately  0.77  (77  percent  or  higher 
accountability).  Similarities  and  differences  between  results  for  the  three 
squadrons  may  be  observed  below,  when  the  transformed  variable  ZZ  is  the  dependent 
variable. 


CRS:  ZZ  =  -0.481  +  0.748C  +  0.303D  +  0.298J  -  0.017L  +  0.446AA 
-  0.005CC  +  1 .095GG  [77%  accountability] 


EMS:  ZZ  =  0.944  +  0.933H  +  3.4010  +  0.324P  -  0.365R  -  0.705S 
+  0.255T  -  0.624U  +  0.106W  +  0.299AA  +  1.016GG 
-  0. 7 7911  +  0.070QQ  +  0.114UU  +  0.267VV  [77%  accountability] 


AGS:  ZZ  =  -1.055  +  0.677C  +  0.604D  +  1.202H  +  0.313J  +  0.297DD 
+  0.13600  -  0.252RR  +  0.103TT  [77%  accountability] 


A  similar  comparison  may  be  made  at  an  R2  comparable  level  of  approximately 
0.90  (90  percent  accountability).  Again  ZZ  is  the  dependent  variable. 


CRS:  ZZ  =  2.369  +  0.805C  -  0.0881  -  0 .031 K  +  0.048M  +  1.382Q 

-  0.631R  +  0.209T  -  0.387U  -  0.136V  -  1.015Y  +  1.181AA 

-  Q.011CC  +  0.483EE  -  0.410FF  +  0.754GG  +  0.069II 

-  0.055RR  +  0.278WW  [92%  accuracy] 


EMS:  Not  Possible  [Maximum  R2  obtained  =  80%] 


AGS:  ZZ  =  -0.044  +  1.456C  +  0.795D  -  1 .294E  +  0.848J  -  1.520N 

-  0.535U  -  0.546AA  +  0.7370D  +  0.440EE  +  0.17900 

-  0.321RR  +  0.105TT  [90%  accountability] 
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Comparison  of  Multiple  Regression  Equations  for  Luke  AFB  405^  TAC  Wing, 
Component  Repair,  Electrical  Maintenance,  and  Aircraft  Generation 
Squadrons  at  Approximately  11%  Accountability  (R2  =  0.77) 
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11  Intercept  -0.481  +0.944  -1 .055 

Predicted  Mean  Performance  Level  ZZ  for  7.661  7.062  6.940 

Squadron 

Actual  Mean  Performance  Level  ZZ  for  7.638  7.073  6.933 

Squadron  (Based  on  supervisor  ratings) 


From  the  above  it  may  be  observed  that  to  increase  R2  from  0.77  to  0.90 
requires  11  more  variables  for  CRS  and  4  more  variables  for  AGS.  For  the  data 
collected  from  EMS,  the  maximum  multiple  R2  is  approximately  80  percent. 

Comparison  in  Table  28  is  therefore  made  at  the  77*  accountability  level.  No 
factors  surfaced  as  significant  for  all  3  squadrons.  Factors  C,  D,  H,  J,  AA 
and  GG  surfaced  as  significant  in  two  of  the  three  squadrons. 

Differences  in  squadron  technician  responses  relative  to  supervisor 
performance  ratings  are  clearly  evident.  Across  the  squadron,  23  of  the 
48  dependent  variables  surfaced  as  significant  predictors  of  performance  at  the 
R2  level  of  0.77  (77  percent  accountability). 

In  Table  29,  results  for  CRS  and  AGS  are  compared  at  approximately  the  90" 
level  of  accountability.  We  note  that  the  eleven  additional  factors  provide  a 
somewhat  better  estimate  of  the  mean  ZZ  performance  score  for  CRS.  The  prediction 
error  at  the  mean  is  0.08  percent  with  the  18  variables  included  as  compared  to 
a  prediction  error  at  the  mean  of  0.30  percent  with  7  variables  included.  For 
AGS,  however,  the  addition  of  4  variables  worsens  the  prediction  error  of  the 
mean.  It  may  also  be  noted  in  Table  30  that  the  factors  of  M  (months  in 
current  assignment),  T  (hours  on  additional  duties,  II  (number  of  service  clubs), 

V  (number  of  persons  supervised),  and  WW  (responsibility  trait)  contribute  little 
to  the  prediction  of  squadron  performance  ZZ. 


Overall  Results  Across  82nd  ATC  Wing  at  Williams  AFB  and  405th  TAC  Wing 
at  Luke  AFB.  A  comparsion  between  the  summary  regression  results  in  Table  15 
X82nd  ATC)  and  the  results  in  Table  28  (405th  TAC)  shows  the  following  (based  on 
77-78  percent  accountability  and  ZZ  as  the  dependent  variable): 

(1)  Twenty  independent  variables  (predictor  factors)  surfaced  as  significant 
for  one  or  both  of  the  two  maintenance  squadrons  of  the  82nd  ATC;  23 
independent  variables  surfaced  as  signficant  for  one  or  two  of  the 
three  maintenance  squadrons  at  the  405th  TAC. 

(2)  Eleven  of  the  same  independent  variables  surfaced  at  the  two  different 
Wings,  namely: 

D.  Persistence  [3  squadrons  -  0MS,  CRS,  AGS] 

H.  Work  Shift  [3  squadrons  -  FMS,  EMS,  AGS] 

J.  Skill  Level  [4  squadrons  -  FMS,  0MS,  CRS,  AGS] 

L.  Equipment  Assignment  Year  [2  squadrons  -  FMS,  CRS] 

P.  Rank  [2  squadrons  -  FMS,  EMS] 

R.  Days  8e tween  Breaks  [2  squadrons  -  0MS,  EMS] 

S.  Number  of  Additional  Duties  [2  squadrons  =  0MS,  EMS] 

U.  Number  of  Clubs  [2  squadrons  -  FMS,  EMS] 

AA.  Clearance  for  Remove/Replace  [4  squadrons  -  FMS,  0MS,  CRS,  EMS] 

GG.  Technician  Skill  [4  squadrons  -  FMS,  0MS,  CRS,  EMS] 

II.  Homogeneity  of  Group  Attitude  [3  squadrons  -  FMS,  0MS,  EMS] 

(3)  Nine  factors  surfaced  for  the  82nd  ATC  that  did  not  surface  for  the 
405th  TAC,  namely: 
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Table  29 


Comparison  of  Multiple  Regression  Equations  for  Luke  405^  TAC  Wing 
for  Component  Repair  and  Aircraft  Generation  Squadrons  at 
Approximately  90"  Accountability 
(R2  =  0.90  or  higher) 


Factor 

CRS 

AGS 

Beta 

Coeff. 

Mean  Contr. 

Beta 

Coeff. 

Mean  Contr. 

1 . 

C  -  Job  Curiosity 

+0.805 

3.328  2.679 

+1 .458 

3.095  4.513 

2. 

D  -  Persistence 

+0.795 

3.143  2.499 

3. 

E  -  Prof.  Ident. 

-1 .294 

2.952  -3.820 

4. 

I  -  Enlist.  Year 

-0.088 

68.897  -6.063 

5. 

J  -  Skill  Level 

+0.848 

4.381  3.715 

6. 

K  -  Duty  Assign.  Year 

-0.031 

67.328  -2.087 

7. 

M  -  Months  Curr.  Assign. 

+0.048 

5.448  0.262 

8. 

N  -  Sex 

-1 .520 

0.786  -1 .195 

9. 

Q  -  Hours/Shift 

+1 . 382 

7.310  10.102 

10. 

R  -  Days  Between  8reaks 

-0.631 

4.466  -2.818 

11. 

T  -  Hrs.  Add.  Duties 

+0.209 

0.862  0.180 

12. 

U  -  No.  of  Clubs 

-0.387 

0.293  -0.113 

-0535 

0.238  -0.127 

13. 

V  -  No.  Persons  Supervised 

-0.136 

1.190  -0.162 

14. 

Y  -  Clearance  for  Servicing 

-1.015 

2.086  -2.117 

15. 

AA  -  Clearance  for 

Remove/Replace 

+1.181 

2.035  2.403 

-0.546 

2.500  -1.365 

16. 

CC  -  Hours  Between  Equip. 

Servicing 

-0.011 

75.603  -0.832 

17. 

DD  -  Quality  Tech.  Infor. 

+0.737 

3.429  2.527 

18. 

EE  -  Quality  Test  Equip. 

+0.483 

3.138  1.516 

+0.440 

1.786  0.786 

19. 

FF  -  Technician  Knowledge 

-0.410 

2.983  -1 .223 

20. 

GG  -  Tech.  Skill 

+0.754 

3.552  2.678 

21. 

II  -  Homogeneity  of  Group 

Attitude 

+0.069 

27.035  1.865 

22. 

00  -  Organization  Warmth 

+0.179 

25.167  4.505 

23. 

RR  -  Assign.  Locality 

-0.055 

20.996  -1.153 

-0.321 

24.000  -7.704 

24. 

TT  -  Social  Status 

+0.105 

24.905  2.615 

25. 

WW  -  Responsibility 

+0.278 

0.569  0.158 

ZZ 

Crossing 

2.369 

-0.044 

11 

Prediction 

7.644 

6.905 

11  Actual  Per  Supervisory  Evaluations 

7.638 

6.933 
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*E.  Professional  Identification  [posi ti ve][shows  for  AGS  at  R2  -  .90] 

F.  Organizational  Identification  [positive] 

G.  Self  Starter  Trait  [positive 

*N.  Sex  [negative  contribution  for  males][shows  for  AGS  at  R2  -  .90] 

X.  Weight  Handled  [positive] 

*E£.  Quality  of  Test  Equipment  [posi ti ve][shows  for  CRS  and  AGS  at 
R2  =  .90] 

PP.  Organizational  Conflict  [negative  contribution] 

SS.  Satisfaction  with  Pay  and  Benefits  [negative  contribution] 

XX.  Emotional  Stability  [negative  contribution] 

(4)  Twelve  factors  surfaced  for  the  405^  TAC  that  did  not  surface  for  the 
82nd  ATC,  namely: 

C.  Job  Curiosity  [positive] 

0.  Equipment  Type  [positive] 

T.  Hours  on  Additional  Duties  [positive] 

W.  Months  in  Supervision  [positive] 

CC.  Hours  Between  Equipment  Services  [negative  contribution] 

DD.  Quality  of  technical  information  [positive] 

00.  Organizational  Warmth  [positive] 

QQ.  Organizational  Identification  [positive] 

RR.  Assignment  Locality  [negative  contribution] 

TT.  Social  Status  [positive] 

UU.  Fatigue  Trait  [positive--affecting  performance  negatively] 

VV.  Ascendency  Trait  [negative  contribution] 

(5)  The  total  number  of  factors  which  surfaced  as  significant  in  one  or 
both  AF  Wings  is  32  of  the  48  possible.  The  following  factors  included 
in  the  questionnaires  did  not  surface  in  the  regression  equations 

[for  77-78%  accountability]. 

I.  Enlistment  Year 
K.  Current  Duty  Assignment  Year 
M.  Months  in  Current  Asisgnment 
*Q.  Hours  Per  Shift 

*V.  Number  of  Persons  Supervised  by  Technician 
*Y.  Clearance  for  Servicing  Equipment 
BB.  Number  of  Internal  Components 
*FF.  Technician  Knowledge 
HH.  Group  Satisfaction  of  Individual  Motives 
JJ.  Satisfaction  with  Interpersonal  Relations 
KK.  Satisfaction  with  Supervision 
LL.  Organization  Structure 
MM.  Organization  Rewards 
NN.  Organization  Risks 
*WW.  Responsibility 
YY.  Sociability 

Some  of  the  above  factors  did  surface  as  significant  predictors  when 
either  A  or  B  alone  were  used  as  the  dependent  variable,  namely: 


‘Factors  show  significance  at  Luke  405^  at  90%  accountability  level. 
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Y,  V,  Q,  FF,  LL,  NN  and  WW.  Also,  at  the  92%  accountability  level 
for  ZZ  with  data  from  the  CRS,  Q,  V,  Y,  FF  and  WW  surfaced. 


(6)  It  is  of  interest  to  observe  which  factors  surfaced  when  (1) 
performance  speed  (A)  was  used  as  the  dependent  variable  and  when 

(2)  performance  quality  (B)  was  used  as  the  dependent  variable.  Table 
30  shows  the  comparison.  Some  of  these  variables  did  not  show  signi¬ 
ficance,  however,  when  the  transformed  variable  ZZ  =  0.4A  +  0.6B 
was  used  as  the  dependent  variable. 

(7)  Correlation  and  covariance  analyses  were  also  made  from  the  BMDP  output 
data.  In  addition  normal  and  detrended  normal  probability  plots  were 
obtained.  For  all  of  the  survey  da'i.a,  the  assumption  of  normality 

is  by-and-large  supported  by  the  data  plots,  with  very  few  outliers 
Plots  are  essentially  linear  on  the  normal  probability  graphs. 

Multi  col  linearity  across  independent  variables  is  indicated  by  large 
correlation  coefficients  in  the  correlation  matrix.  One  of  the 
advantages  of  the  stepwise  linear  forward  and  backward  multiple 
regression  procedure  is  the  dependent  variables  are  withdrawn  from  the 
prediction  equations  that  are  correlated  with  one  or  more  other  variables 
which  contribute  a  larger  amount  to  the  predicted  quantity.  Thus  multi - 
collinearity  is  minimized  with  proper  choice  of  the  stepwise  parameters. 
Remaining  correlations  in  the  matrices  were  mostly  between  +  0.2000, 
i.e.,  -0.2000  <  R  <  +0.2000. 
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Table  30 


Comparison  of  Significant  Variables  for  Predicting  Performance 
Speed  (A)  vs.  Predicting  Performance  Quality  (B). 

A  and  8  are  Excluded  as  Predictor  Variables. 


Predictor 

Variable 


Dependent  Variable 
is  Performance 
Speed  (A) 


Dependent  Variable 
is  Performance 
Quality  (B) 


C  -  Job  Curiosity 
D  -  Persistence 
E  -  Prof.  Ident. 

F  -  Organization  Ident. 

G  -  Self  Starter 
H  -  Work  Shift 
I  -  Enlis.  Year 
J  -  Skill  Level 
K  -  Duty  Assignment  Year 
L  -  Equip.  Assignment  Year 
N  -  Sex 

0  -  Equipment  Type 

P  -  Rank 

Q  -  Hours/Shift 

R  -  Days  Between  Breaks 

S  -  No.  Add.  Duties 

T  -  Hrs.  Additional  Duties 

U  -  No.  Clubs 

V  -  No.  Persons  Supervised 
W  -  Months  Supervision 

X  -  Weight  Handled 

Y  -  Clearance  for  Service 
AA  -  Clear.  Remove/Replace 
CC  -  Hrs.  Between  Servicing 

DD  -  Quality  Tech.  Information 
EE  -  Quality  Test  Information 
FF  -  Technician  Knowledge 
GG  -  Technician  Skill 
HH  -  Sat.  Indiv.  Motives 
II  -  Homogeneity  of  Attitude 
JJ  -  Sat.  Interper.  Rel . 

LL  -  Organization  Structure 
00  -  Organization  Warmth 
PP  -  Organization  Conflict 
QQ  -  Oranization  Identity 
SS  -  Assign. /Local ity 
UU  -  Fatigue  Trait 
WW  -  Responsibility 
XX  -  Emot.  Stability 
YY  -  Sociability 


-- 

X ( FMS ,  CRS) 

X(EMS) 

X ( OMS ,  CRS) 

X(EMS) 

X ( EMS ,  AGS) 

X ( FMS ,  OMS,  CRS) 

X ( OMS ) 

— 

X(OMS) 

X ( FMS ,  EMS) 

X ( EMS ) 

— 

X ( OMS ,  AGS) 

— 

X( FMS,  AGS) 

X ( FMS ,  AGS) 

X ( OMS ,  CRS) 

X(AGS) 

X(0MS,  CRS) 

X(FMS) 

X(0MS,  EMS) 

X ( OMS ) 

X ( OMS ) 

X(OMS) 

X ( OMS ) 

X ( FMS ,  EMS,  AGS) 

— 

X(EMS) 

X( EMS) 

X ( OMS ,  CRS) 

X(CRS,  AGS) 

X( FMS,  AGS) 

X(AGS) 

X(AGS) 

X(FMS) 

X ( OMS ,  EMS) 

X ( FMS ) 

X ( EMS ) 

X(CRS) 

— 

X( FMS,  CRS) 

— 

— 

X(CRS,  EMS) 

X ( FMS ,  EMS) 

X ( OMS ) 

X(OMS) 

— 

X(CRS,  EMS) 

X(OMS) 

-- 

X ( EMS ) 

-- 

X(EMS) 

— 

X( EMS) 

X ( OMS ) 

— 

-- 

X( AGS) 

— 

X(OMS) 

X ( OMS ) 

— 

— 

X( AGS) 

-- 

X ( OMS ) 

-- 

X(EMS) 

X(CRS,  EMS,  AGS) 

X(OMS) 

X( EMS,  AGS) 

— 
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PLANNED  PUBLICATIONS 


A  summary  article  on  this  research  is  being  prepared  for  submission  either 
to  the  TRANSACTIONS  of  the  American  Institute  of  Industrial  Engineers  or  HUMAN 
FACTORS,  the  latter  a  publication  of  the  Human  Factors  Society. 


PROFESSIONAL  PERSONNEL  ASSOCIATED  WITH  RESEARCH 

The  principal  researcher  is  Hewitt  H.  Young,  P.E.,  Ph.D. ,  a  Professor  of 
Engineering  at  Arizona  State  University.  Professor  Young  currently  teaches  with¬ 
in  the  Department  of  Industrial  and  Management  Systems  Engineering  and  directs 
teaching  and  research  activities  in  human  engineering.  He  holds  the  BSME  and 
MSIE  degrees  from  Case  Institute  of  Technology  and  the  Ph.D.  degree  (Engineering) 
from  Arizona  State  University.  His  most  recent  publication  was  in  HUMAN  FACTORS, 
1979,  21(4),  p.  399-407  in  an  article  entitled,  "The  Impact  of  Environment  on  the 
Productivity  Attitudes  of  Intellectually  Challenged  Office  Workers."  Professor 
Young  was  an  ASEE/USAF  Summer  Faculty  Fellow  in  1978  assigned  to  the  AF  Human 
Resources  Laboratory,  Advanced  Systems  Division,  Wright- Patters on  AFB,  Ohio. 

This  current  research  is  an  outgrowth  of  research  begun  during  the  summer  1978 
period. 

The  1978  summer  study  was  supervised  by  Mr.  Robert  C.  Johnson,  research 
psychologist  for  AFHRL/ASR.  Mr.  Johnson  has  continued  his  active  interest  in 
this  research  area  by  serving  as  program  monitor  for  the  current  research  pro¬ 
ject.  He  was  particularly  helpful  in  getting  Air  Force  clearance  for  the  study 
and  the  effort  is  much  appreciated. 

Two  graduate  students  at  Arizona  State  University  were  also  involved  in 
certain  aspects  of  the  research  effort.  Captain  Joel  R.  Hickman,  an  AFIT  graduate 
student,  considered  the  problem  of  developing  suitable  supervisor  performance 
rating  scales  for  technicians  as  an  engineering  report  effort.  His  work  resulted 
in  the  scales  for  supervisory  ratings  of  technician  speed  and  quality  of  per¬ 
formance  which  were  used  in  the  research.  Captain  Hickman  received  his  B.S.  degree 
from  the  University  of  California  at  Los  Angeles.  He  is  a  career  Air  Force 
officer  who  has  now  completed  the  MS  degree  with  industrial  engineering  major 
from  ASU.  Parts  of  Mr.  Hickman's  master's  engineering  report  are  included  in 
this  report.  A  complete  copy  of  his  engineers  report  can  be  obtained  at  repro¬ 
duction  costs  from  the  Department  of  Industrial  and  Management  Systems  Engineering, 
ASU.  Captain  Hickman  was  of  invaluable  help  to  the  principal  researcher  because 
of  his  knowledge  of  Air  Force  organizations  and  procedures.  He  also  helped  with 
the  data  collection  at  Williams  AFB.  His  current  assignment  is  at  K.I.  Sawyer 
AFB,  Michigan. 

The  second  graduate  student  involved  in  the  project  is  Mr.  Mark  J.  Bramlett. 
Mr.  Bramlett  helped  the  author  in  the  conduct  of  the  survey  at  Luke  AFB  and  with 
some  of  the  analytic  work.  He  holds  B.S.  and  M.S.  degrees  from  Oklahoma  State 
University  and  is  pursuing  the  Ph.D.  degree  at  ASU.  He  also  holds  a  position  as 
graduate  research  assistant. 
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INTERACTIONS  WITH  AIR  FORCE  ORGANIZATIONS 


The  research  involved  extensive  surveys  of  maintenance  technicians  and  their 
immediate  supervisors  at  Williams  AFB  and  Luke  AFB,  Arizona.  The  survey  instru¬ 
ments  were  developed  during  the  early  phases  of  the  project  and  then  reviewed  for 
content  with  AFHRL/ASR.  Mr.  Johnson  and  his  staff  provided  valuable  inputs  for 
survey  instrument  modification.  The  modified  survey  instruments  were  then  sub¬ 
mitted  to  AFMPC/DPMYPS  (Randolph  AFB)  for  approval  by  Dr.  Gordon  A.  Eckstrand, 
Technical  Director  for  ASR  Laboratory. 

Prior  to  operational  activation  of  the  project,  letters  were  addressed  to 
Headquarters,  Tactical  Air  Command  and  Headquarters,  Air  Training  Command  through 
Lt.  Colonel  James  A  Cline,  USAF,  Chief,  Advanced  Systems  Division.  These  letters 
requested  the  assistance  and  cooperation  of  the  Commands  relative  to  conduct  of 
the  surveys  at  Williams  and  Luke  AFB's.  A  request  was  also  directed  to  the  Deputy 
Commander  Maintenance  at  each  of  the  two  AFB’s  for  local  support  of  the  project. 

As  part  of  the  survey  review  procedure  at  AFMPC/DPMYPS,  Captain  David  Gambrell 
requested  letters  from  Williams  and  Luke  AFB's  indicating  agreement  to  partici¬ 
pate  in  the  surveys,  having  reviewed  the  survey  instruments.  Clearance  was  also 
requested  from  the  two  Chief  Base  Personnel  officers,  since  both  military  airmen 
and  civilian  employees  were  to  be  included  in  the  sample.  At  Williams  AFB, 
meetings  were  held  with  Lt.  Colonel  Lanier  (CBPO),  Lt.  Ford  of  the  personnel 
office,  Mr.  Standquist  (CCP)  in  charge  of  civilian  personnel,  and  local  Union 
representatives.  At  Luke  AFB,  meetings  were  held  with  Major  Love  (CBPO),  and 
Mr.  Cody  (CCP).  Cooperation  was  excellent  in  getting  approvals,  which  were  then 
forwarded  to  AFMPC/DPMYPS  at  Randolph.  The  researcher  also  directed  a  letter  to 
Mr.  Galloway  of  AF/MPKE,  Pentagon,  to  expedite  national  clearance  for  the  use  of 
civilian  employees  in  the  survey,  and  he  in  turn  provided  an  authorization  letter 
to  AFMPC/DPMYPS. 

Approval  for  conducting  the  surveys  was  received  from  AFMPC/DPMYPS  in  early 
October,  1979,  and  arrangements  were  initiated  to  conduct  the  surveys  through 
Colonel  Thomas  E.  Walker,  Deputy  Commander  Maintenance  for  the  Williams  AFB  82nd 
wing,  and  Colonel  James  W.  Vorhees,  Deputy  Commander  Maintenance  for  the  Luke 
AFB  405th  Wing.  The  study  was  conducted  first  at  Williams  AFB,  with  the  invalu¬ 
able  help  of  Captain  Jerry  Raney  of  the  DCM's  staff.  Captain  Raney  devoted  a 
great  deal  of  time  to  working  with  this  writer  and  Captain  Joel  Hickman  in  the 
selection  of  the  sample,  providing  a  suitable  classroom  for  the  surveys,  following 
up  to  see  that  proper  notifications  were  given  to  personnel  and  soliciting  attend¬ 
ance,  and  personally  attending  all  of  the  survey  sessions  over  a  two-week  period. 
The  researchers  also  met  with  Colonel  William  J.  Breckner,  Jr.,  who  is  a  recent 
incumbent  as  82nd  Wing  Commander,  to  explain  the  purpose  of  the  study  and  receive 
his  authorization. 

At  the  survey  orientation  session  at  Luke  AFB,  Captain  David  Bump  represented 
HQTAC  and  Captain  Bob  Tilton  was  assigned  by  the  DCM  to  work  with  the  researchers 
on  the  project.  Colonel  Charles  A.  Horner,  Wing  Commander  for  the  405th,  provided 
authorization  for  the  study.  As  at  Williams  AFB,  Captain  Tilton  took  on  the 
important  tasks  of  helping  with  the  sample  selection,  providing  a  classroom  for 
the  surveys,  getting  supervisors  and  technicians  to  the  survey  sessions,  and 
personally  attending  some  of  the  sessions. 

The  researcher  wishes  to  thank  all  of  those  mentioi  d  above,  the  maintenance 
squadron  commanders  and  supervisors  at  both  Air  Force  t  ses,  and  the  many  main¬ 
tenance  technicians  who  participated  in  the  study  for  their  courteous  and  valuable 
contributions  to  this  research  effort.  Letters  of  appreciation  were  sent  at  an 
earlier  date  to  Colonel  Breckner  and  Colonel  Horner. 


68 


CONCLUSIONS  AND  RECOMMENDATIONS 


The  proposed  Air  Force  Maintenance  Squadron  Performance  Prediction  Model, 
which  will  be  labeled  AFMSPPM  and  consists  of  a  variety  of  survey  inputs, 
provides  a  very  good  estimate  of  a  squadron's  performance  level  based  on  results 
of  this  research  study  at  Williams  and  Luke  Air  Force  Bases.  The  multifactor 
model,  based  on  survey  inputs  from  a  sampling  of  maintenance  technicians  and 
their  immediate  (shift)  supervisors  within  a  squadron,  will  predict  a  squadron 
performance  level  with  a  78  to  92  percent  accountability  when  compared  to  the 
average  of  supervisor  performance  ratings  for  the  same  sample  of  maintenance 
technicians.  In  addition,  the  survey  responses  of  any  one  technician,  when  used 
as  inputs  in  the  AFMSPPM,  will  provide  a  good  prediction  (correlate  well)  with 
the  supervisor's  performance  rating  for  that  technician.  In  this  latter  case, 
the  coefficient  weightings  used  with  the  factor  responses  by  a  technician  are 
determined  across  the  squadron  sample. 

The  squadron  survey  model  consists  of 

(1)  a  representative  sample  of  technicians  responses  to  150  survey  questions, 
covering  138  items  and  18  factors, 

(2)  selected  biographical  data  on  each  of  the  sampled  technicians 

(3)  immediate  (shift)  supervisor  inputs  on  motivation  traits  for  each  of 
the  sampled  technicians,  and 

(4)  immediate  supervisor  inputs  on  equipment  and  environmental  factors 
which  may  influence  each  sampled  technician's  work. 

In  the  research  study  performance  ratings  were  made,  for  each  of  the  techni¬ 
cians  sampled,  of  speed  and  quality  of  work.  These  two  performance  ratings  were 
first  independently  used  as  dependent  measures  in  the  multiple  regression  analyses 
and  were  then  combined  into  a  single  performance  measure  such  that  speed  of 
work  was  weighted  by  0.4  and  quality  of  work  by  0.6.  Based  on  limited  inputs 
to  the  researcher,  these  weightings  appear  to  be  representative  of  maintenance 
commander  (DCM)  feelings  in  a  peacetime  situation.  In  time  of  war,  speed  of 
work  would  probably  be  weighted  more  heavily. 

In  the  multiple  regression  analyses,  differences  in  the  factors  which  surfaced 
as  significant  for  different  squadrons  may  be  observed.  These  differences  may 
be  attributed  to 

(1)  particular  aircraft  equipment  serviced  by  a  squadron, 

(2)  organization,  construct  and  activities  of  the  particular  maintenance 
squadron, 

(3)  conditions  within  the  squadron  at  the  time  of  the  survey  which  may 
influence  technician  responses, 

(4)  personal  attitudes  and  traits  of  the  technicians  involved,  and 

(5)  extent  to  which  an  averaging  of  supervisor  performance  ratings  of  a 
sample  of  technicians  within  a  squadron  actually  represent  a  squadron 
performance  level. 
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For  each  particular  maintenance  squadron,  the  factors  and  weightings 
which  surfaced  in  the  multiple  regression  analyses,  when  combined  in  the 
prediction  model,  gave  an  excellent  prediction  of  averaged  supervisor  performance 
ratings.  Thus  the  survey  model  can  be  employed  as  a  substitute  for  supervisor 
performance  ratings  and  has  the  distinct  advantages  of  (1)  involving 
the  technicians  themselves,  through  a  sampling  process,  in  rating  squadron  per¬ 
formance  and  (2)  highlighting  those  particular  factors  or  conditions  which  are 
contributing  either  positively  or  negatively  to  the  squadron  performance  level. 
Such  input  provides  squadron  and  wing  management  with  valuable  information  for 
improvement  and  control. 

Most  of  the  factors  included  in  the  developed  AFMSPPM  have  shown  significance 
as  predictors  of  maintenance  squadron  performance  in  at  least  one  of  the  five 
squadrons  studied.  Several  of  the  factors  were  significant  in  two  or  three  of 
the  squadrons.  At  this  juncture,  therefore,  no  portion  of  the  survey  model  should 
be  eliminated.  However,  additional  studies  at  other  Air  Force  bases  and  for  other 
squadrons  may  well  suggest  that  the  inclusion  of  survey  questions  in  support  of 
certain  factors  is  not  worthwhile.  The  general  survey  model  could  then  be 
reduced  and  require  less  survey  input  and  time. 

Based  on  differences  observed  to  date  in  applying  the  AFMSPPM,  it  would 
appear  that  only  certain  portions  of  the  survey  model  might  be  used  for  particular 
types  of  squadrons  and/or  particular  equipment  types  serviced.  That  is,  all 
Field  Maintenance  squadron's  in  the  Air  Force  may  have  sufficient  similarities 
such  that  some  factors  in  the  AFMSPPM  would  often  prove  significant  and  other 
factors  would  seldom  or  never  prove  significant.  Likewise,  Air  Force  maintenance 
squadrons  servicing  a  particular  type  of  aircraft  may  have  particular  characteri¬ 
stics  which  would  emphasize  certain  factors  in  the  model  and  deemphasize  others. 
Additional  research  is  needed  at  other  Air  Force  Bases  and  for  a  variety  of 
maintenance  squadrons  to  clarify  whether  either  of  the  above  is  true. 

In  conclusion,  this  research  has  been  a  limited  effort  to  (1)  develop  a 
comprehensive  survey  instrument  for  use  with  maintenance  technicians  and  their 
immediate  supervisors,  combining  factors  (independent  variables)  which  have  shown 
significance  in  previous  maintenance  performance  studies,  such  that  the  combined 
responses  for  a  squadron  would  be  predictive  of  a  squadron  performance  level,  and 
(2)  by  means  of  survey  data  input  to  a  stepwise,  linear  multiple  regression  model 
to  generate  for  a  particular  squadron  a  prediction  model,  which  would  indicate 
both  squadron  performance  level  and  the  factors  which  were  contributing  to  such 
performance  level  at  a  point  of  time.  The  results  across  two  Air  Force  Wings, 
at  two  AF  bases  and  involving  a  total  of  5  maintenance  squadrons,  are  very 
encouraging.  The  study  should  be  extended  to  other  AF  bases. 

The  AFMSPPM  eventually  offers  the  promise,  probably  in  a  somewhat  reduced 
form,  of 

(1)  permitting  an  AF  maintenance  squadron  or  Wing  to  periodically  assess 
its  overall  performance  level  by  direct  input  from  the  technicians 
and  shift  supervisors, 

(2)  permitting  an  AF  maintenance  squadron  or  Wing  to  assess  the  performance 
of  each  technician  in  a  squadron  against  squadron  performance,  based 
solely  on  inputs  from  the  technicians  themselves  and  selected  super¬ 
visory  inputs  on  equipment,  environment  and  technician  motivation  traits, 
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(3)  establishing  a  performance  predictive  model  for  each  squadron  type 
and/or  each  equipment  type, 

(4)  permitting  a  squadron  to  compare  model  inputs  at  two  or  more  points 
of  time  and  ascertaining  those  factors  which  are  increasing  or 
decreasing  in  their  contributions  towards  effective  squadron  perfor¬ 
mance,  and 

(5)  establishing  a  means  for  accurate  life-cycle  costing  of  maintenance 
technician  activity  for  a  particular  type  of  end  item  equipment, 
placed  at  particular  AF  bases,  and  supported  by  given  maintenance 
squadrons . 
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1.  Maintenance  performance  measures  are  significantly  affected  by 
hardware  system  desgin. 

2.  For  jet  engine  depot  maintenance  (.turbofans  and  turbojets),  over¬ 
hall  costs  are  significantly  affected  by  engine  design  and  operating 
parameters  and  average  flight  hours  between  engine  overhauls. 

3.  22%  of  the  variance  in  time  to  perform  maintenance  on  autopilot 
avionics  can  be  attributed  to  the  design  of  test  equipment. 

4.  PROMIS  job  selection  provides  a  small  increase  in  job  interest  and 
in  airman  felt  utilization  of  talents  and  training  where  assignment 
is  made  to  first  choice  at  time  of  enlistment. 

5.  There  is  a  strong  interaction  between  measured  individual  differences 
(and  attitudes)  and  maintenance  task,  performance. 

6.  Technician  skills,  knowledge  and  overall  capability  are  primarily 

a  function  of  training.  Formalized  on-job  training  is  more  effective 
than  classroom/theoretical  training. 

7.  Measured  abilities  and  values  of  technicians  are  useful  in  ascer¬ 
taining  what  particular  task  charactersi tics  will  appeal  to  certain 
persons . 

8.  ASVAB  test  grades  and  educational  backgrounds  of  airmen  are  highly 
correlated  with  final  school  grades  (training  center). 

9.  Long-term  recall  of  learned  skills  is  a  function  of  the  type  of  task, 
learning  parameters,  retention  Interval  parameters  and  recall  parameters. 

10.  Persons  differ  widely  In  their  reactions  to  location  and  work  environ¬ 
ment.  Fears  can  be  diminished  with  familiarity  gained  through 
training  and  experience. 

11.  Management  decisions  at  the  Wing  level  can  significantly  affect 
sypply  costs. 


Lack  of  spares  is  not  a  serious  deterrant  to  maintenance  performance 
effectiveness . 

The  Cost  Center  Performance  Measurement  System  (CCPMS)  has  not 
been  well  received  by  the  Commands,  since  the  output  measures  are 
not  considered  particularly  useful.  Further,  for  similar  output 
measure  values  across  units,  the  actual  performance  costs  vary  widely. 

Style  and  quality  of  supervision  have  highly  significant  affects  on 
technician  performance  and  job  satisfaction. 

Supervisory  conditioning  of  maintenance  tasks  has  an  important 
impact  on  technician  job  satisfaction. 

Important  airman  satisfiers,  in  addition  to  the  quality  of  supervision, 
include: 

job  security 

opportunity  for  technical  training 

accomplishing  work  that  gives  a  feeling  of  achievement 

Job  Guide  improvements  which  incorporate  more  illustrations,  logic 
and  procedural  charts,  completeness  of  information,  clarity  and 
dual-level  of  presentation  are  well-received  by  maintenance  per¬ 
sonnel  and  can  significantly  affect  both  performance  time  and  per¬ 
formance  accuracy. 

Human  errors  by  maintenance  personnel  in  the  Air  Force  can  be  cate¬ 
gorized  as: 

40*  -  failure  to  follow  procedures 

10%  -  incorrect  diagnosis 

10%  -  misinterpretation  of  communication 

20“  -  inadequate  support,  tools,  test  equipment,  environment 

20%  -  insufficient  attention  or  caution 

Environmental  temperature  and  fatigue  characteristics  both  affect 
performance  capability. 


20.  Other  conditions  which  may  impact  upon  technician  performance 
i ncl ude : 

Organizational  climate,  including  team  cohesive¬ 
ness,  structure,  warmth,  etc. 

Personal  traits  of  technician,  including  job 
curiosity,  persistence,  etc. 

Assignment  location 
Impact  of  Pay  and  Benefits 
Social  Status  of  Occupation 

21.  Maintenance  airmen  have  a  lower  degree  of  job  satisfaciton  than 
for  other  AFSC's. 

22.  Reducing  or  eliminating  present  disincentives  for  maintenance 
personnel  probably  is  more  cost  effective  than  to  add  new  incentiv 

23.  Adequate  feedback  on  performance  is  needed  for  both  airmen  and 
supervi sors . 
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APPENDIX  B 
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Survey  Instruments  Used  in  Study 


MAINTENANCE  TECHNICIAN  SURVEY 


The  attached  survey  is  part  of  a  research  effort  being  conducted 
by  Arizona  State  University  under  contract  with  the  Air  Force  Office 
of  Scientific  Research,  and  with  the  cooperation  of  the  Air  Force  Human 
Resources  Laboratory,  Advanced  Systems  Division,  WPAFB,  Ohio.  The 
purpose  of  the  survey  is  to  further  identify  factors  which  influence 
performance  effectiveness  in  maintaining  Air  Force  aircraft  and  missile 
systems. 

Your  participation  in  the  Survey  is  voluntary  but  strongly 
desired.  Your  responses  will  be  held  confidential  and  in  no  way  will 
impact  upon  your  career  nor  upon  the  squadron  to  which  you  are  assigned. 

Headquarters  USAF  Survey  Control  Number  80-11 _ has  been  assigned 

to  this  survey. 

The  value  of  this  research  effort  is  dependent  upon  the  effort 
you  make  to  provide  open,  honest  responses  to  each  question.  Please 
turn  the  page  and  read  the  Privacy  Act  Statement  and  Instructions 
before  proceeding.  Thank  you  for  your  valued  cooperation. 
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PRIVACY  STATEMENT 

Survey  of  Air  Force  Maintenance  Technicians 


a.  Authority: 

(1)  5  U.S.C.  301,  Departmental  Regulations;  and/or 

(2)  10  U.S.C.  8012.  Secretary  of  the  Air "Force.  Powers  Duties. 
Delegation  by  Compensation;  and/or 

(3)  DOD  Instruction  1100.1$,  17  Apr.  68,  Surveys  of  Department 

•  *nd/°r 

(4)  AFR3Q-23,  Zi  Sep  7<»,  Air  Force  Personnel  Survey  Program 

b.  Principal  purposes:  To  collect  Information  from  Air  Force  and 
civilian  squadron  maintenance  personnel  concerning  their  per¬ 
ceptions  of  factors  which  influence  their  performance  effective¬ 
ness.  To  Initiate  the  development  of  an  Air  Force  Maintenance 
Performance  Effectiveness  Model  based  on  the  survey  results  and 
other  Inputs. 

c.  Routine  Uses:  Data  will  be  used  for  research  purposes  in 
Initiating  a  predictive  model  of  maintenance  performance 
effectiveness. 

d.  Participation  Is  voluntary.  However,  your  cooperation  Is 
requested. 

e.  No  adverse  action  of  any  kind  may  be  taken  against  any  Individual 
who  elects  not  to  participate  In  any  or  all  of  this  survey. 

Please  return  the  survey  booklet  to  the  Project  Monitor  If 

you  wish  to  withdraw. 
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INSTRUCTIONS 


Your  responses  to  the  survey  questions  are  to  be  machine  scored  by 
OptScan  technology.  Accordingly,  all  answers  are  to  be  marked  on 
the  separate  ISM  answer  sheet  loosely  Inserted  In  this  survey  booklet 
Remove  the  answer  sheet  from  the  booklet  and  use  It  to  record  your 
answers  by  blackening  In  the  appropriate  answer  rectangle,  marked 
A,B,C,D  and  E,  for  each  question.  Cleanly  erase  answers  you  want  to 
change.  00  NOT  make  stray  pencil  marks  on  the  sheet.  Check  to  be 
sure  that  only  ONE  answer  rectangle  Is  blackened  for  each  question. 
Use  only  the  No.  2  pencil  provided  or  a  comparable  pencil  with 
medium  soft  lead. 

For  control  purposes,  an  Identification  number  has  been  preassigned 
to  each  survey  booklet  and  appears  In  a  large  block  on  the  bottom 
of  the  next  page.  This  five-digit  Identification  number  should  be 
marked  onto  the  first  five  rows  of  the  coding  section  entitled 
IDENTIFICATION  NUMBER  at  the  top  right  of  the  answer  sheet.  Please 
make  sure  that  the  number  is  correctly  reproduced  for  machine  scoring 
Ignore  all  other  heading  Information. 


Note  that  the  answer  sheet  treats  question  numbers  from  left  to  right 
with  questions  1  to  4  on  the  top  row.  Be  sure  to  use  the  correct 
answer  block  for  each  question,  by  question  number. 

Now  turn  the  page  and  complete  the  Biographical  Data  before  beginning 
to  respond  to  the  questions. 

Later,  after  you  have  finished  responding  to  the  survey  questions, 
reinsert  the  answer  sheet  In  the  survey  booklet  and  turn  both  In 
together  to  the  project  monitor.  Be  sure  that  you  have  provided 
your  Identification  Number  on  the  answer  sheet.  Thank  you. 
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BIOGRAPHIC  INFORMATION 

(Please  complete  before  responding  to  survey  questions) 


Oat*  of  onlistaont  or  aoployaont  by  USAf^_ _ /  ^ 

List  yo or  primary  AFSC  Outy  AFSC  Sacondary  AFSC 

Wat  your  skill  level  f1.3.S.7.9l 

When  Mr*  you  ossigned  to  your  duty  AFSC  /  _ 

Month  Year 

Uhon  Mr*  you  first  assigned  to  your  eurrant  aircraft  or  oissilt  system: 
Month  Vaar . 

If  you  work  with  a  team,  how  long  hava  you  boon  with  your  prosont  ttam 


Months 

Who  Is  your  Immediate  supervisor? _ _ 

Circle  your  sax:  Halo  Foaalo 

Circla  your  USAF  amploymont  status:  Military  Civilian  ART 
What  squadron  do  you  belong  to 

What  typo  and  oodol  aircraft  or  alssilo  do  you  maintain 

List  your  rank  or  civilian  ooploymnt  orado 

How  many  hours  do  you  currently  Work  in  a  shift  (circla  one) 

C  t  10  12  14  IS 

Mow  oany  days  do  you  work  between  breaks  (circle  one) 

4  S  S  7  I  10  12  W  Other 

Now  many  additional  duties  do  you  have  (clrclo  one)  0129  Othar_ 
Mow  aany  hours  a  week  do  you  currently  devote  to  your  additional  dutias 
(circle  one)  0  2  4  «  I  Other 

Now  oaiqr  service  or  interest  clubs  do  you  participate  in?  __________ 

Oo  you  supervise  the  uork  of  others?  Tos  MO 

If  yes.  how  wny  others  do  you  supervise? 

If  yes.  how  long  have  you  boon  a  supervisor?  Months 

+*  TOUR  ASS!  GNU  SURVtT  CONTROL  RIMER  IS 


PLEASE  MARK  THIS  NUMBER  ON  THE  ANSWER 
CORRECT  NUMBERS*  WORKING  TOP  TO  BOTTOM 


SHEET  BY  BLACKENING  IN  THE 


MAINTENANCE  TECHNICIAN  SURVEY 
Part  I.  Group  Morale 

This  first  portion  of  the  questionnaire  requests  your  frank  feelings 
about  your  job,  your  immediate  su  pervlsor  and  your  fellow  workers.  There 
are  no  right  or  wrong  answers.  The  best  answer  Is  your  honest  personal 
opinion. 

You  may  agree  or  disagree  with  each  of  the  following  statements.  If 
you  strongly  agree  with  a  statement  blacken  rectangle  A  on  the  answer  sheet 
(by  question  number).  If  you  just  agree  with  the  statement  mark  rectangle  E. 
If  you  mildly  disagree  with  the  statement  mark  rectangle  C.  If  you 
strongly  disagree  with  the  statement  mark  rectangle  D.  Rectangle  E  is  not 
usea.  Following  question  1  is  an  example  of  the  answer  categories  applicable 
to  all  questions  in  PART  I. 

I.  I  feel  that  what  I  am  doing  here  gives  me  a  chance  to  make  friends. 

A.  Strongly  Agree  B.  Agree  C.  Disagree  D.  Strongly  Disagree 

2.  I  believe  that  all  my  associates  in  my  work  group  hold  beliefs  that  are 
unreasonable. 

3.  Most  of  my  associates  here  would  help  me  If  I  needed  help. 

4.  My  Immediate  supervisor  Is  out  for  his  own  advancement;  he  doesn't  care 
about  me. 

5.  My  supervisor  can  always  be  relied  upon  to  do  the  right  thing. 

6.  I  just  tolerate  the  people  I  associate  with  here. 

7.  All  of  my  work  group  associates  are  a  dull  lot  and  don't  think  seriously 
about  Important  Issues. 

8.  I  feel  that  there  Is  plenty  of  chance  to  get  ahead  In  what  I  am  doing  now. 

9.  I  would  never  make  friends  with  any  of  my  associates  here. 

10.  My  supervisor  Is  out  to  help  me  as  much  as  he  can. 

II.  I  seldom  pay  attention  to  what  other  people  say;  I  believe  In  making  my 
own  decisions. 

12.  1  feel  that  I  have  made  some  lasting  friends  among  my  associates  in  my 

work  group. 
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13.  I  believe  that  the  work  I  do  now  keeps  me  In  a  rut. 

14.  I  feel  that  I  can  ask  advice  of  most  of  my  work  associates. 

15.  Most  of  my  work  associates  are  stubborn,  no  amount  of  argument  will 
change  them. 

16.  Just  a  few  of  my  work  group  associates  are  open-minded;  most  of  them 
have  biased  points  of  view. 

17.  My  supervisor  got  ahead  because  of  his  connections,  not  because  of  his 
ability. 

18.  Sometimes  I  like  what  I  am  doing  here,  but  most  of  the  time  I  hate  it. 

19.  Most  of  my  work  associates  would  risk  their  own  security  if  It  were 
necessary  for  the  good  of  all. 

20.  I  believe  that  most  of  my  work  associates  would  "stab  me  In  the  back" 
If  It  meant  they  could  get  ahead  that  way. 

Part  II.  Organization  Climate 

This  portion  of  the  questionnaire  requests  your  feelings  about  the 
local  organization  within  which  you  work.  As  In  Part  I,  you  may  agree  or 
disagree  with  each  of  the  following  statements.  If  you  strongly  agree 
with  the  statement,  mark  rectangle  A.  If  you  just  agree  with  the  statement, 
mark  rectangle  B.  If  you  disagree  mark  C,  and  mark  D  if  you  strongly  dis¬ 
agree.  Begin  with  answer  block  21.  Following  question  21  Is  an  example  of 
the  answer  categories  applicable  to  all  questions  In  PART  II. 

21.  The  jobs  In  this  squadron  are  clearly  defined  and  logically  structured. 

A.  Strongly  Agree  B.  Agree  C.  Disagree  D.  Strongly  Disagree 

22.  In  this  squadron  It  is  sometimes  unclear  who  has  the  formal  authority 
to  make  a  decision. 

23.  The  policies  and  organization  structure  of  the  squadron  have  been 
clearly  explained. 

24.  Red-tape  Is  kept  to  a  minimum  In  this  squadron. 

25.  Excessive  rules,  administrative  details,  and  red-tape  make  It  difficult 
for  new  and  original  Ideas  to  receive  consideration. 
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26.  Our  productivity  sometimes  suffers  from  lack  of  organization  and  planning. 

27.  In  some  of  the  projects  I've  been  on,  I  haven't  been  sure  exactly  who  my 
boss  was. 

28.  Our  management  Isn't  so  concerned  about  formal  organization  and  authority, 
but  concentrates  instead  on  getting  the  right  people  together  to  do  the  job 

29.  We  have  a  promotion  system  here  that  helps  the  best  man  to  rise  up  to 
the  top. 

30  In  this  squadron  the  rewards  and  encouragements  you  get  usually  outweigh 
the  threats  and  the  criticism. 

31.  In  this  squadron  people  are  rewarded  in  proportion  to  the  excellence  of 
their  job  performance. 

32.  There  is  a  great  deal  of  criticism  in  this  squadron. 

33.  There  is  not  enough  reward  and  recognition  given  in  this  squadron  for 
doing  good  work. 

34.  If  you  make  a  mistake  in  this  squadron,  you  will  be  punished. 

35.  The  philosophy  of  our  management  is  that  in  the  long  run  we  get  ahead 
faster  by  playing  It  slow,  safe,  and  sure. 

36.  Our  business  has  been  built  up  by  taking  calculated  risks  at  the  right  time 

37.  Decision  making  In  this  squadron  Is  too  cautious  for  maximum  effectiveness. 

38.  Our  management  is  willing  to  take  a  chance  on  a  good  Idea. 

39.  We  have  to  take  some  pretty  big  risks  occasionally  to  meet  the  sortie 
requirements  of  the  wing. 

40.  A  friendly  atmosphere  prevails  among  the  people  in  this  squadron. 

41.  This  squadron  Is  characterized  by  a  relaxed,  easy-going  working  climate. 

42.  It's  very  hard  to  get  to  know  people  In  this  squadron. 

43.  People  In  this  squadron  tend  to  be  cool  and  aloof  toward  each  other. 

44.  There  Is  a  lot  of  warmth  In  the  relationships  between  management  and 
workers  In  this  squadron. 

45.  The  best  way  to  make  a  good  Impression  around  here  Is  to  steer  clear  of 
open  arguments  and  disagreements. 

46.  The  attitude  of  our  management  Is  that  conflict  between  competing  units 
and  Individuals  can  be  very  healthy. 
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47.  We  are  encouraged  to  speak  our  minds,  even  if  It  means  disagreeing  with 
our  superiors. 

48.  In  management  meetings,  the  goal  Is  to  arrive  at  a  decision  as  smoothly 
and  quickly  as  possible. 

49.  People  are  proud  of  belonging  to  this  squadron. 

50.  I  feel  that  I  am  a  member  of  a  well  functioning  team. 

51.  As  far  as  I  can  see,  there  isn't  very  much  personal  loyalty  to  the  squadron. 

52.  In  this  squadron  people  pretty  much  look  out  for  their  own  Interests. 


Part  III.  Occupational  Attitude 

(To  be  completed  only  by  Air  Force  Personnel.  Civilian  employees  should  skip 
to  Part  IV  of  the  questionnaire). 

This  third  portion  of  the  questionnaire  Is  Intended  to  explore  your 
feelings  about  your  job  with  the  Air  Force  relative  to  assignment  locality, 
pay  and  benefits,  and  social  status. 

Different  scales  are  to  be  used  In  Part  III.  If  you  are  Very  Satisfied 
with  the  statement  given  as  It  pertains  to  your  position  as  an  airman  In 
the  USAF,  blacken  A  on  the  answer  sheet  OR  mark  B  for  Satisfied,  C  for 
Unsatisfied,  D  for  Very  Unsatisfied.  Give  a  true  picture  of  your  feelings 
and  respond  rapidly  without  going  back  to  previous  Items  marked.  Begin 
with  answer  sheet  block  53.  Following  question  53  Is  an  example  of  the 
answer  categories  applicable  to  all  questions  In  PART  III. 

53.  The  geographical  area  to  which  you  are  assigned. 

A.  Very  Satisfied  B.  Satisfied  C.  Unsatisfied  0.  Very  Unsatisfied 

54.  The  attitudes  of  civilians  around  your  base  toward  the  Air  Force. 

55.  The  educational  opportunities  provided  by  the  surrounding  community. 

55.  The  IX  and  Commissary  facilities  at  your  base. 
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57.  The  cost  of  living  In  the  area  to  which  you  are  assigned. 

58.  The  similarity  between  your  assignment  and  your  assignment  preference. 

59.  The  facilities  provided  by  the  base. 

60.  The  distance  to  your  home  of  record. 

61.  The  on-base  housing. 

62.  The  size  of  your  base. 

63.  The  size  of  the  surrounding  community. 

64.  The  additional  duties  associated  with  your  job. 

65.  The  cultural  opportunities  provided  by  the  surrounding  community. 

66.  The  recreational  opportunities  provided  by  the  surrounding  communi  ty. 

67.  On-base  and  off-base  transportation  facilities. 

68.  The  quality  of  base  quarters,  barracks,  or  civilian  housing  in  which  you  live. 

*  69.  The  quality  of  food  and  availability  of  eating  facilities  at  your  base  or 

location. 

70.  The  amount  of  money  you  can  make  in  the  Air  Force. 

,  71.  Your  pay  compared  to  what  you  could  make  on  the  outside. 

72.  The  protection  provided  by  the  Air  Force  Life  Insurance  program. 

73.  Your  fringe  benefits  compared  to  fringe  benefits  offered  by  a  civilian  job. 

i  74.  The  advantages  provided  by  the  commissary  and  BX. 

75.  The  opportunity  for  you  or  your  family  to  travel  at  military  rates. 

76.  The  standard  of  living  which  your  Income  provides. 

I  77.  The  quality  of  medical  care  provided  by  the  Air  Force. 

78.  The  retirement  Income  you  would  receive  from  an  Air  Force  career. 

79.  The  benefits  provided  by  the  Air  Force. 

f  80.  The  cost  of  TOY  versus  the  payment  received. 

81.  The  extent  to  which  your  military  pay  covers  your  living  expenses. 

82.  The  respect  that  results  from  your  rank  and  job. 

< 
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83.  The  opportunity  to  meet  and  work  with  Important  people. 

84.  Your  social  position  In  the  Air  Force  as  a  result  of  your  job. 

85.  The  status  you  have  in  the  civilian  community  because  of  your  job.  • 

86.  The  prestige  that  goes  with  your  position. 

87.  The  status  given  a  military  man  by  the  civilian  community. 

88.  The  pride  your  family  has  in  your  work. 

89.  Your  prestige  in  the  military  community  resulting  from  the  type  of  work 
you  do. 

90.  The  prestige  your  family  receives  as  a  result  of  your  job. 

91.  The  feelings  you  get  from  wearing  the  Air  Force  uniform. 

92.  The  status  your  job  gives  compared  to  the  status  you  would  expect  as  a 

civilian . 


Part  IV.  Feelings  While  Working 

The  statements  listed  below  describe  how  a  person  may  feel  while  working. 
Reac  each  statement  carefully  and  decide  whether  It  Is  applicable  to  how  you 
generally  feel  when  you  are  at  work.  If  It  Does  describe  your  feelings, 
blacken  A  In  the  answer  block.  If  It  Does  Wot  describe  your  feelings,  mark 
rectangle  B.  Rectangles  C,  D,  E  are  not  used  In  Part  IV.  Begin  with  answer 
sheet  block  93.  Following  question  93  Is  an  example  of  the  answer  categories 
applicable  to  all  questions  In  PART  IV. 

93.  Can't  seem  to  think. 

A.  Does  describe  B.  Does  not  describe 

94.  Lack  patience. 

95.  Feel  a  little  hoarse. 

96.  Have  a  headache. 

97.  Feel  unsteady  on  my  feet. 

98.  Body  feels  generally  tired. 


99.  Can't  think  clearly;  have  "cobwebs". 

100.  Lack  self-confidence. 

101.  Feel  thirsty. 

102.  Want  to  lie  down. 

103.  Don't  want  to  talk  anymore. 

104.  Seems  hard  to  sit  or  stand  up  straight. 

105.  Find  it  hard  to  breathe. 

106.  Feel  drowsy. 

107.  Feel  sick  to  my  stomach;  nauseous. 

108.  Feel  stiff  and  cramped  In  the  shoulders. 

109.  Eyelids  twitch. 

110.  Seem  to  have  no  interest  in  things. 

111 .  Feel  like  yawning. 

112.  Feel  anxious  about  things. 

113.  Feel  dizzy. 

114.  Eyes  feel  strained. 

115.  Seem  to  forget  things. 

116.  Legs  feel  tired. 

117.  Hard  to  hole  my  head  up;  feels  heavy. 

118.  Arms  and  legs  feel  "shaky. 

119.  Feel  aches  and  pains  In  my  back. 

120.  Feel  clumsy  and  rigid  when  moving  around. 

121.  Unable  to  concentrate  for  very  long. 

122.  Feel  nervous. 

123.  feel  bored. 

124.  Keep  watching  my  watch  or  a  clock. 


Part  V.  Personal  Traits 
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In  this  final  part  of  the  survey  are  a  number  of  descriptions  of  personal 

characteristics  of  people.  The  descriptions  are  grouped  Into  sets  of  four. 

Following  each  set  of  four  descriptions  are  two  questions:  (1)  Which  Is 

MOST  LIKE  YOU,  and  (2)  which  Is  LEAST  LIKE  YOU.  Mark  the  answer  sheet  in 

rectangle  A  If  the  A  description  applies,  mark  B  If  the  B  description 

applies,  mark  C  if  the  C  description  applies  and  mark  D  if  the  D  description 

applies.  Begin  with  answer  sheet  block  125. 

A  A  good  mixer  socially 
B  Lacking  in  aelf-conf idence 
C  Thorough  in  any  work  undertaken 
D  Tends  to  be  somewhat  emotional 

125.  In  above  statements,  the  one  most  like  you  Is  (mark  A,B,C  or  0  on  answer  sheets 

126.  In  above  statements,  the  one  least  like  you  is(mark  A,B,C  or  D  on  answer  sheet, 


A  Mot  Interested  in  being  with  other  people 
B  Free  from  anxieties  or  tensions 
C  Quite  an  unreliable  person 
D  Takes  the  lead  in  group  discussion 

127.  In  above  statements,  the  one  most  like  you  Is 

128.  In  above  statements,  the  one  least  like  you  is 


A  Acts  somewhat  jumpy  end  nervous 
B  A  strong  influence  on  others 
C  Does  not  like  social  gatherings 
D  A  very  persistent  and  steady  worker 

129.  In  above  statements,  the  one  most  like  you  Is 

130.  in  above  statements,  the  one  least  like  you  Is 


A  Finds  it  easy  to  make  new  acquaintances 
B  Cannot  stick  to  the  same  task  for  long 
C  Easily  managed  by  other  people 
D  Maintains  self-control  even  when  frustrated 

131.  In  above  statements,  the  one  most  like  you  Is 

132.  In  above  statements,  the  one  least  like  you  Is 


n 


A  Able  to  sake  Important  decisions  without  help 
B  Does  not  mix  easily  with  new  people 
C  Inclined  to  be  tense  or  high-strung 
D  Sees  a  Job  through  despite  difficulties 

133.  In  above  statements,  the  one  most  like  you  is 

134.  In  above  statements,  the  one  least  like  you  is 


A  Not  too  interested  in  mixing  socially  with  people 
B  Doesn't  take  responsibilities  seriously 
C  Steady  and  composed  at  all  times 
D  Takes  the  lead  in  group  activities 

135.  In  above  statements,  the  one  most  like  you  is 

136.  In  above  statements,  the  one  least  like  you  is 


A  A  person  who  can  be  relied  upon 
B  Easily  upset  when  things  go  wrong 
C  Not  too  sure  of  own  opinions 
D  Prefers  to  be  around  other  people 

137.  In  above  statements,  the  one  most  like  you  is 

138.  In  above  statements,  the  one  least  like  you  is 


A  Finds  it  easy  to  Influence  other  people 
B  Gets  the  job  done  in  the  face  of  any  obstacle 
C  Limits  social  relations  to  a  select  few 
D  Tends  to  be  a  rather  nervous  person 

139.  In  above  statements,  the  one  most  like  you  is 

140.  in  above  statements,  the  one  least  like  you  is 


A  Doesn't  make  friends  very  readily 
B  Takes  an  active  part  in  group  affairs 
C  Keeps  at  routine  duties  until  completed 
D  Not  too  well-balanced  emotionally 

141 .  In  above  statements,  the  one  most  like  you  Is 

142.  In  above  statements,  the  one  least  like  you  is 


A  Assured  in  relationships  with  others 
B  Feelings  are  rather  easily  hurt 
C  Follows  well— developer  work  habits 
D  Would  rather  keep  to  a  small  group  of  friends 

143.  In  above  statements,  the  one  most  like  you  is 

144.  In  above  statements,  the  one  least  like  you  is 


A  Becomes  irritated  somewhat  readily 
B  Capable  of  handling  any  situation 
C  Does  not  like  to  converse  with  strangers 
D  Thorough  in  any  work  performed 

145.  In  above  statements,  the  one  most  like  you  is 

146.  In  above  statements,  the  one  least  like  you  Is 


A  Prefers  not  to  argue  with  other  people 
B  Unable  to  keep  to  a  fixed  schedule 
C  A  calm  and  unexcitable  person 
D  Inclined  to  be  highly  sociable 

147.  In  above  statements,  the  one  «ost  like  you  is 

148.  In  above  statements,  the  one  least  like  you  is 


A  Tree  from  worry  or  care 
B  Lacks  a  sense  of  responsibility 
C  Not  interested  in  mixing  with  the  opposite  sex 
D  Skillful  in  handling  other  people 

149.  In  above  statements,  the  one  most  like  you  is 

150.  In  above  statements,  the  one  least  like  you  is 


END  OF  SURVEY.  PLEASE  RETURN  BOOKLET  AND  ANSWER  SHEET. 


MAINTENANCE  TECHNICIAN  SURVEY 
SUPERVISORS  TECHNICIAN  MOTIVATION  EVALUATION 


All  first  and  second  level  supervisors  of  participants  in  the 
Maintenance  Technician  Survey  are  requested  to  complete  a  Supervisors 
Technician  Evaluation  Form  for  each  technician  on  the  enclosed  listing 
(persons  either  directly  under  your  supervision  or  under  the  super¬ 
vision  of  those  whom  you  supervise).  The  enclosed  number  of  forms 
provided  in  the  packet  should  match  the  number  of  technicians  on 
your  list. 

The  Maintenance  Technician  Survey  Is  being  conducted  as  part  of  a 
research  effort  being  conducted  by  Arizona  State  University  under  con¬ 
tract  with  the  Air  Force  Office  of  Scientific  Research,  and  with  the 
cooperation  of  the  Air  Force  Human  Resources  Laboratory,  Advanced 
Systems  Division,  WPAFB,  Ohio.  Headquarters  USAF  Survey  Control 

Number _ has  been  assigned  to  this  survey.  Participation  of 

the  airman  and  civilians  selected  is  voluntary  and  each  subject  will 
be  provided  with  a  Privacy  Statement  and  have  an  opportunity  to  decline 
participation. 

The  purpose  of  the  Maintenance  Technician  Survey,  to  be  conducted 
at  only  Williams  and  Luke  Air  Force  Bases  at  this  time,  is  to  collect 
information  from  Air  Force  and  civilian  squadron  maintenance  personnel 
concerning  their  perceptions  of  factors  which  influence  their  performance 
effectiveness.  A  second  objective  is  to  initiate  the  development  of 
an  Air  Force  Maintenance  Performance  Effectiveness  Model  based  on  the 
survey  results  and  other  inputs.  The  research  data  is  intended  for 
general  Air  Force  use  and  Is  not  Intended  as  a  means  of  performance 
measurement  at  either  Base. 

Your  thoughtful  cooperation  In  completing  the  Supervisors 
Technician  Evaluation  Form  for  each  of  the  technicians  on  the  enclosed 
list  is  requested^  Then  please  complete  the  separate  Supervisors 
Technical  Information  and  Performance  Rankings  Form  covering  all of  the 
equipment  and  personnel  under  your  supervision.  Tf  you  are  a  shop  chief, 
please  rank  the  airman  and  civilians  who  report  to  the  supervisors 
which  you  direct. 

The  enclosed  list  of  personnel  who  were  selected  for  the  Maintenance 
Technician  Survey  either  directly  report  to  you  or  report  to  a  supervisor 
who  In  turn  reports  to  you.  Next  to  the  names  on  the  list  are  assigned 
Survey  Control  Numbers.  Only  the  Survey  Control  Number  is  to  be  placed 
on  the  Supervisors  Technician  Evaluation  Form  (one  number  per  form)  in 
keepl ng  with  the  Privacy  Act  of  1976^  ~ 

However,  the  separate  Supervisors  Technical  Information  and 
Performance  Rankings  form,  one  required  for  your  entire  area  of 
supervision,  Is  to  treat  all  of  the  equipments  and  personnel  under 
your  supervision.  Names  of  all  of  the  personnel  reporting  to  you, 
or  to  the  supervisors  under  you,  may  be  used  In  the  part  2  perform¬ 
ance  rankings.  Note  that  the  rankings  are  not  to  be  limited  to  only 
those  technicians  on  the  selected  list  of  subjects  who  completed  the 
maintenance  technician  survey. 

Thank  you  for  your  cooperation  in  this  research  effort. 


SUPERVISORS  TECHNICIAN  EVALUATION  FORM 
for  Maintenance  Technician  Survey 
September  1979 


Scale 

1 


Maintenance  Squadron _ _  _ 

Your  Name _ Your  Supervisory  Position _ 

Survey  Control  Number  of  Maintenance  Technician  to  be  Evaluated 

Instructions :  You  are  requested  to  evaluate  the  above  referenced 

technician  on  five  important  traits  which  are  motivation  indicators. 

For  each  item,  two  written  statements  of  motivation  behavior  are 

provided  at  the  extreme  ends  of  a  vertical  line  scale.  For  each  item, 

you  are  to  place  an  X  somewhere  along  the  line,  at  the  point  which 

in  your  opinion  best  represents  this  technician's  typical  behavior. 

The  type  of  motivation  which  each  item  is  designed  to  measure  is  written 

along  the  vertical  rating  scale.  Note  that  your  responses  are  for 

research  purposes  only  and  will  not  become  part  of  the  technicians 

personnel  record.  Place  an  X  on  each  of  the  five  trait  scales. 

1 .  Job  Curiosity  Trait  of  Technician. 

When  working,  this  individual  would  be  most  likely  to: 

seek  out  information  about  other  parts  of  the  aircraft  and  try  to 
find  out  how  his/her  tasks  fit  into  the  whole  system,  even  if  such 
|  information  was  not  essential  to  his/her  task  performance. 


9 

U 


work  only  on  his/her  task  and  would  not  care  how  his/her  work 
relates  to  the  whole  system. 


2.  Persistence  Trait  of  Technician 


While  working  on  a  long  task,  the  technician's  work  group  ran 
out  of  a  crucial  lubricant  and  no  additional  supplies  were 
available  in  the  shop.  This  individual  would  be  likely  to: 


willingly  go  to  another  shop  to 
■complete  the  job,  whether  asked 


get  the  lubricant  necessary  to 
to  or  not. 


Scale 

2 


<L> 

U 

C 

GJ 


use  this  as  an  excuse  to  stop  work  on  the  task  and  leave  the 
problem  for  someone  else,  or  complain  if  asked  to  get  the  lubricant. 


3.  Professional  Identification  Trait  of  Technician 


This  individual  would  be  likely  to: 

show  pride  In  his/her  AFSC,  training,  and  job,  and  consider 
his/her  dally  work  worthwhile  to  the  Air  Force. 


consider  his/her  AFSC  "worthless"  and  possibly  degrading.  Also, 
he/she  would  consider  his/her  job  unnecessary  busy  work  which 
did  not  use  his/her  talents. 


» 


4.  Organizational  Identification  Trait  of  Technician 
This  Individual  would  be  likely  to: 


take  pride  In  his/her  participation  In  the  squadron  and/or 
work  group,  and  cooperate  harmoniously  with  supervisor  and/or 
associates . 


continually  complain  about  the  squadron  and/or  work  group  and 
display  alienation  towards  supervisor  and/or  associates. 


5:  Self-Starter  Trait  of  Technician 

An  urgent  work  order  has  unexpectantly  come  down  to  the  shop. 
If  this  Individual  had  a  "routine"  dental  appointment,  he/she 
would  be  likely  to: 

ask  the  supervisor  for  a  few  minutes  to  call  and  cancel  or 
_  delay  the  appointment  so  he/she  could  become  Involved  In 
I  the  ur<»ent  work  • 


Scale 


f 


complain  to  tho  supervisor  that  he/she  could  not  possible  re¬ 
schedule  the  appointment  end  ask  to  get  out  of  the  work. 


SUPERVISORS  TECHNICAL  INFORMATION  AND  PERFORMANCE  RANKINGS  FORM 


for  Maintenance  Technician  Survey 
September  1979 

[One  form  to  be  completed  covering  your  area(s)  of  supervision.] 

Maintenance  Squadron _ 

Your  Name _ _ 

Your  Job  Classification  or  Title_ _ 

Part  I.  Technical  Information 


Instructions :  Both  first  and  second  level  supervisors  are  requested  to 
describe  the  technical  systems,  test  and  repair  equipments,  and  technical 
information  with  which  their  technicians  work.  Please  provide  your  best 
estimate  on  each  of  the  following  9  items  by  marking  an  X  along  the 
horizontal  scale  at  an  appropriate  position. 

1.  What  is  the  average  estimated  weight  in  pounds  of  the  subsystems 
(assemblies)  which  are  serviced  by  the  group(s)  you  supervise? 

0  pounds  40  80  120  1*40  200  or  more 


2.  How  difficult  Is  it,  on  the  average,  for  your  technicians  to  service 
assigned  subsystems,  based  on  the  accessibility  or  clearance  for 
servicing? 


simple  (adequate  clearance) 
0  1  2 


most  difficult  (very  tight 
>  c  clearance) 


3. 


How  difficult  Is  it,  on  the  average,  for  your  technicians  to  remove 
and/or  replace  subsystems  (or  components),  based  on  the  accessibility 


or  clearance  for  such  tasks? 
simple  (adequate  clearance) 
0  1  2 


most  difficult  (very  tight 
»  c  clearance) 


4.  What  Is  the  average  number  of  Internal  components  your  group(s) 
deals  with  In  servicing  subsystems? 


5.  Estimate  the  average  hours  between  servicing  actions  for  the 
subsystems  serviced  by  your  group(s). 


6.  Rate  the  adequacy  of  the  technical  information  available  to 
your  group(s)  for  servicing  subsystems. 

poor  excellent 

0  1  2  3  4  5 


7.  Rate  the  usability  of  the  test  equipment  available  to  your  group(s) 
for  the  subsystems  serviced  (leave  this  blank  if  your  group(s)  does 
not  use  test  equipment). 


8.  Estimate  the  average  knowledge  of  the  technicians  you  supervise 
for  the  subsystems  serviced. 

tow  high 

0  1  .2  3  4  5 


9.  Estimate  the  average  skills  of  the  technicians  you  supervise 
for  the  subsystems  serviced. 

low  high 

0  1  2  .3  4  5 


Part  2.  Performance  Rankings 

Instructions :  Two  separate  rankings  are  desired  for  all  of  the 
technicians  whom  you  supervise.  Since  you  have  worked 
directly  with  the  technicians  as  a  first-level  supervisor,  or  have 
observed  the  technicians  in  action  as  a  second-level  supervisor,  you 
are  well  qualified  to  rank  the  speed  (work  productivity)  and  the 
quality  (work  accuracy)  of  each  technician  under  your  direct  super¬ 
vision  [or  direct  observation].  The  first  performance  ranking  Is  for 
Speed,  the  second  for  Quality.  In  each  case,  after  the  technicians 
have  been  rank  ordered  by  Speed  or  by  Quality  of  performance,  you  are 

requested  to  scale  the  expected  level  of  performance  from  1  to  10, 
with  10  being  used  for  the  top-ranked  technician  In  each  category. 


SPEED  OF  PERFORMANCE  RANKINGS 
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QUALITY  OF  PERFORMANCE  RANKINGS 
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APPENDIX  C 


FORTRAN  IV  Computer  Program  for 
Processing  Survey  Data  (including  a 
complete  example  output).  Program 
prepares  data  input  on  cards  for 
BM0P2R  Statistical  Package. 

Data  for  Williams  AF3,  Field  Maintenance 
Squadron 
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APPENDIX  D 


Brief  Summary  on  BMDP  Statistical  Programs 


13.2 


P2R 


Sample  page  from  BMDP  77/  Series  P  Manual 
Health  Sciences  Computing  Facility 
Department  of  Biomathematics 
School  of  Medicine 


Univ.  cf  California  at  Los  Angeles 

Stepwise  Regression 


P2R  computes  estimates  of  the  parameters  of  a  multiple  linear  regression 
equation  in  a  stepwise  manner.  That  is,  the  variables  are  entered  (forward 
stepping)  or  r^ve^jkackward-  stepping)  from  the  equation  one  at  a  time)  accor 
ding^to  any  of  iPSTirpnccihlg...  criteria^.  The  order  of  entry  or  removal  can  be 
speei-fied  entirely  or  in  part.  The  regression  equation  can  be  estimated  with 
or  without  an  intercept. 


•  Resuljs 

The  Werner  blood  chemistry  data  (Table  5.1)  are  used  to  illustrate  the 
results  produced  by  P2R.  In  Example  13.7  we  request  that  a  stepwise  regression 
be  performed  with  QJOLSTRj.  as  the  dependent  variable.  Only  the  REGRess  para¬ 
graph  is  specific  to  P2R.  The  remaining  Control  Language  instructions  are 
described  in  Chapters/ 


Example  13.7 


/PROBLEM  title  is  ’WERNER  91000  CHEMISTRY  OATA’. 

/INPUT  VARIABLES  ARE  9. 

RJPMAT  IS  MA4. 5F4.0,3F4.l)  •. 

/VARIABLE  NAMES  ARE  id, age, height, weight, brthpill, 

CHOLSTRL,  ALBUMIN,  CALCIUM,  URIC  AC  ID. 
MAXIMUM  IS  (61400. 

MINIMUM  IS  I  61  ISO. 

BLANKS  ARE  MISSING. 

LABEL  IS  10. 

/REGRESS  OEPENOENT  IS  CHOLSTRL. 

/END 


Th«  Control  Language  must  be  preceded  by  System  Cards  to  Initiate  the  analysis  by  P2R. 
At  HSCF,  the  System  Cards  are 

"7/jobname  J08  nooo  .youmame 
//  EXEC  BIMED.PR0G»BMQP2R 
//SYS  IN  00  * 

The  Control  Language  is  iurwdiately  followed  by  the  data  (Table  5.1).  The  analysis 
is  terminated  by  another  System  Card.  At  HSCF,  this  System  Card  is 

C" 


The  results  of  the  regression  analysis  are  presented  in  Output  13.7.  The 
circled  numbers  below  correspond  to  those  in  the  output. 

(T)  Complete  cases  only  are  used  in  the  computations;  i.e.,  cases  that  have 
no  missing  values  or  values  out  of  range.  Therefore  only  180  of  the 
original  188  cases  are  used.  All  variables  are  checked  for  invalid  values 


-399- 


APPENDIX  E 


Example  Output  of  BMDP2P.  Statisical 
Program  (Multiple  Linear  Stepwise  Regression). 
Shows  Output  for  Williams  Air  Force  Base, 

Field  Maintenance  Squadron  Data. 
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FORTRAN  IV  Program  Output  for  Williams 
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FORTRAN  IV  Program  Output  for  Luke  AFB, 
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